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The role of statewide coordinating/governing agencies 
in the program review and approval process has grown steadily. It 
would seem expedient for those involved in the process of state level 
program review to share ideas, experiences, and concepts of the 
review process in order to better understand +-he process itself and 
to explore possibilities for further development and refinement of 
their own agencies* procedures. This survey attempts to facilitate 
the information exchange by the various state agencies in this 
important area. In January 1975 requests were made to the 50 state 
coordinating agencies which are members of the State Higher Education 
Executive Officers (SHEEO) organization for copies of their policies 
and procedures for program review. For the purpose of analysis, the 
review procedures utilized by the various states have been divided 
into two major sections: (1) review of new and expanded programs and 
(2) the review of existing programs. (Author/Ki.) 
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state of ^lo arL" and LhaL,.."iL will bo iin|M>rLnnL Lo oxchan:\o idoas 
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A SURVEY AND ANALYSIS OF STATE- LEVKL PROGRAiM REVIEW IN HIGHER EDUCATION 



I . Introduc Lion 

It is perhaps axionuitic that few issues are more sensitive to higher 
education than that of st.iLe-level program review and approval. The 
idea that "outsiders", "state bureaucrats", or "representatives of a 
political environment" might meddle in academic affairs probably tran- 
scends all of the other administrative and coordinative issues relating 
to statewide coordination of higher education. The principle of "peer 
evaluation and review" in academe .appears to be as well established 
the skepticism of program review by almost anyone else ouc.-ide AcadeuK .^ 

Despite these long entrenched institutional values favoring autonomy, 
the role of statewide coordinating/governing agencies in the program 
review and approval process has been growing steadily. Tlie development 
of the program review function has parallelled the development of the 
agencies themselves. Like the agencies, the program review function 
has emerged from relative obscurity to an important role in the co- 
ordination and planning of higher education. Some degree of program 
review was exercised by the early coordinating agencies primarily in 
relation to the budgetary process. As the number .aL-agencies increased 
and their role in the decision making process evolved from voluntary 
through advisory then regulatory responsibilities, and in some instances, 
to governing authority, the function of program review has become 
commonplace. At the present time about forty- four state agencies have 
statutory responsibility for the review of academic programs. Eight of 
these agencies have only authority to make recommendations regarding the 
programs reviewed. Tlie other thirty six dgcncub have actual approval 
responsibility. In arldition to these states with stiituiory rosponsibLlity 
several other agencies conduct reviews a?, a mntter of agency policy. 

That this function should- increasingly fall upon (lu- coordinating 
agencies is ba.sed en the conclusion.s apparently reached in mny states 

that neither the organs ..£ state government no- Uie in.sti lutions of 
higher education arc capable of conducting finely balanced assessments 
involved m program review, the former because the issues are too complex 
lor non-professionals to handle and the latter because their own self- 
interest often inhibits their objectivity". ^ 

Given this growth in the responsibilities of state-wide coordinating 
agencies for program review, it is perhaps inevitable that considerable 
interest will be drawn to this area from both within and outside of the 
educational community. It would seem expedient for those involved in 
the process of state level program review to share idea.s, experiences 
and concepts of the review process in order to better understand the 
process itself and to explore possibilities for further development and 
refinement of their own agencies' procedures. It is hoped that this 
survey will be instrumental in the facilitation of infornuition exchange 
by the various state agencies in this important area. 
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In January, 1975 iv.quosts were n^idc to the iiJ iv <a:\t:c coordiuat inj^ 
agencies which are members of the State Higher KchKaLion Executive' 
Oificer^ i^SllKKO) or-ani ?:ation lor copier^ oC their policies and pro- 
cedures for program review, A i'ollow-up letter was later sent to 
states which had not responded to tlie initial reqiu-it. Ail total 
lorly responses were received 1 rom the SlIKIilO a-oneies. lu additl(^n 
to those agencies prcwiding the requested information, eir,lif ar.onci.s 
indicated that they had no procedures for program review ov wore in the 
process of developing such procedures and could not respond to our re- 
quest at this time, 

A preliminary analysis of the survey shows that while the program 
review function has not greatly changed in the major criteria utilized 
(i.r>., need, consistency with mission, cost, rcscmrces) iLi ivquired 
documentation has steadily heconie more comprehensive and s. Kiiisticatcd . 
lor the purposes of analysis the review procedures utili^xHrhy the 
various states have heen divided into two major sections: (1) Review 
of new and expanded programs; and (2) the review of existing programs. 
This division his been chosen priiairily because of fmpfMLant diifcrences 
ix^tveen tue two and th^* more sc^nsitive nature i>j ihc latter, 

Berdahl-^ and r:i<.nny (et, a 1. / ' have identified three key asmvts of 
program review: (1) the determination of the programs to Oe reviewed- 
(2) the criteria to be used in judging these programs; and (3) the 
mechanism or process of review, lliese same thme aspr-cts will bo 
analysed here with respect to both new and -i.tLn- progivams,' 

T I , Review of T i ew and Expanded Programs 

A, Programs to be Reviewed 

Most of the procedures adopted by the various states begin with a defini- 
trion of the programs to be reviewed, lliese definitions generally set 
the parameters of the review process with respect to a given agency and 
are usually based upon the agencies legal authority in this area. 

The following definitions are typical of the definition statcmc^nts: 
example H (Rliode Island) 

''Reasonable and moderate extensions or alterations of 
existing programs do not require board approval, but 
should come to the attention of the board as an^informa- 
tion item, llie following programs arc subject to review 
by the Board of Regents: 

U Any new program of instruction, excluding 
individual courses, 

2. The proposal for any new department, division, 
school or college, 

3. Any operation funded from external sources requiring 
a commitment of state resources which offers a pro-' 
gram of instruction that requires an excess of 
?200,00C in external funds and/or which entails a 

O „ ^^^^ commitment of longer than two yoars/* 



Rxiuiiple #2 (Arkansas) 

'*nie AcL osLabUshcd Lhat Programs Lo be cvaluatod by 
Lhe board should include: 

•establisbmont of a college, school, division, insLitute, 
deparLmcMiL, new cnrricular or nvujors leading Lo a new degree 
program, exUMision service, or oLhor unit not pn^sently 
included in the program of the institution. 'Ilio term docs 
not include reasonable and moderate extensions as defined 
by the board, of existing curricular, research or public 
service programs which have a direct relationship to 
existing programs 

Example (Tennessee) 

1. "All new academic programs should be submitted to the 
Commission for review. A new program is considered to 
be a new major which leads to a certificate or dcM^'^^e 
at a level or in a field not hitherto offered by the 
institution. A new program may involve the addition of 
courses to a curriculum, or it may consist entirely of 
existing courses packaged in a manner which constitutes a 
new major. If an institution desires merely to add an 
additional option or area of emphasis within an existing 
major and certificate or degree, this would not require ' 
commission action. New credit certificate programs should 
be approved by the commission. Normally, a certificate pro- 
gram which requires approval is one which requires completion 
of a prescribed set of degree credit courses. The awarding of 
n certificate for continuing education or non-college credit 
work does not require commission action. 

2. Ail m-w d< 'grees should be snbmitLed ior review and action 
by the Commission. If hi institution desires lo change the 
type of degree or certificate which it offers, or add anot'ier 
degree or certificate at tlie same level curn^ntly offered, 
for an existing major, this should be submitted to the 
Commission for review. For example, if institution A offers 
a Master of Science degree in Accounting and also desires 
to award a Master of Business Administration degree in 
Accounting, then Institution A should seek the approval of 
the Commission. 

^- Changes i n existing programs or titles should be submitted 
for action if the change represents a significant variation 
in the curricular program. For example, it Institution li 
offers a Bachelor of Science in iiotany and a Bachelor of 
Science in Zoology and desires to consolidate them into a 
Bachelor of Science in Ceneral Biology, then Institution B 
should request the approval of the Commission. Changes of 
a less substantial nature which do not materially affect the 
nature of the program need not be submitted for the Conmiission • s 
action, but should he reported to the Commis sion f or informa - 
tion only. Wlien an institution discontinues a program or 
degree or certificate, the Commission should be informed of 
Q this, but action by the Commission is not ruruLied- 
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Kxample #4 (Virginia) 

"For the purpose of evaluation, a degree pro^.ram is defined 
as an area of spee iali'^aLion (najor) for whicli reCi)gnit.ion 
is intended to be ^iven by the conferring; of a degree, llie 
following factor.s will be taken into consideration in identify- 
ing a degree program; 

1. Program Nomenclature: The title by which the 
area of specialization is identified. 

2. Program Classification Code: llie code number 
under which degrees conferred are reported on tlie 
U.S.O.E. IIKGIS Survey, Form 2300-2, J. 

3. Degree Level: Hie levels of the degree awarded. 
Example #5 (Washington) 

" Pror^ram : A series of prescribed courses, research seminars 
and other related activities in a major field of concentra- 
tion which results in the awarding of a degree. When 'program' 
is referred to in subsequent documents concerning the under- 
graduate level, the term shall apply to only "those programs 
which require a substantial adjustment of staff and resources," 

B. Criteria for Review (See Figtire One) 

Seven major criteria commonly included in the program review procedures 
of the various state coordinating agencies can be identified. These 
seven common criteria are; 1) Program description; 2) purposes and 
objectives; 3) need analysis; 4) cost analysis; 5) resource analysis; 
6) program accreditation; and 7) availability of adequate student financial 
aid. (Note: Tlie degree of specificity of the required response to each 
component varies considerably betwen the states.) 

1. Program Description. Usually the first required criteria of program 
review is a description of the progrr.m oeing proposed.' Tliis could range 
from a simple catalog- type statement to a cSmprehensive , well-documented 
report including the entire proposed and related curriculum, prerequisites, 
credits, method of instruction, degree(s) to be granted and courses taught' 
by related departments. 

2. Purposes and Objectives. While the degree of detail required in this 
area varies, it generally consists of a statement of what the proposed 
program is intended to achieve and the degree of consistency with the 
institutional (or other unit) mission and the state master plan (if one 
exists). 

3. Need Analysis. This section in most states is a justification for 
the proposed program generally concerned with: the need for the program 
at the institution and within the state; tlie demand or student interest 
in the program; the likely projected enrollment; the relationship to 
manpower needs; the opportunities for employment; the likelihood of un- 
necessary duplication with similar programs at other public or private 
institutions within the state and attempts to establish cooperative 

Y-T^ir> arrangements with other institutions. o 
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'i. CosL Analvsi.s. This soctiion ^;cMiorally i^sinl)! i ;Jks Km. direct, 
iiulirocl, incnMiionfal and reallocaLod costs, o\ i\h' proposi d pru^^raui i.or 
a given poriod of xc.irs ran:un;; ivom two to six ars and the ^unrcc'(.s) 
from which i'un<liuj> is anticipated. 

5. Rcsonrco Analysis, 'il^c wov(\ "rt'sourcc" u i.-d iiciv' in the broad 
sense to include all nejL-:.;sary r(*sourcc:>, i)nih<:n oi ut '^.n/i si- , that 

arc needed to support the j>ropot;od pro-r,-Mii. 5:ome state .ij^LUcLes re- 
quest a complete faculty vitae wi^il.r otheri> are concerned xnAy witS tlie 
number of individuals involved (e.^^,., nr., Cijdnate Assistants, support 
staff). A nurahcr of states require inf.)nrtntLo.i on oquLpment, lihrary 
resources n:ul facilities. Sevi^ral states r .{uln- .-'iu'Ciilc luformafioi) 
on the adini:ilstr:itive requirements of t.;.- proposed prorj'im. 

o. Accreditation, llie accreditation requirement can ran^,i trom a 
simple statement regarding wlio, if anyone, iiccredits tlic proposed 
pro<;ram(s) to a detailed Jistin[^ of the accreditation requirements, 
the present accreditation status (in the case, of related or expanded 
programs); u'hat resources or commiimtMit is acceded iii order to acliieve 
accreditation; and a timetable for meeting the various rrquircuK^nts. 
A few states also require that programs mee^ standards of quality sucli 
as the t-uidclinos of the National Graduate Council. 

7. Financial Aid. A few states require evidence of the availability 
of adequate financial aid for students primarily in graduate programs. 

Use of Formulas 



In some states, these various compomwits require the application of 
specific formulas. Missouri, for example, makes specific reference to 
the "Clapp-Jordan formula" for determinipg institutional surpluses or 
deficiencies in library holdings and doctoral faculty teaching loads 
"not exceeding two or three courses per term", in otlu^r states, only 

general statement is rtqur-sted in r(^-T>ons. \n f],rs(v various components 
although the institutions* could ronci.^vah'v n . juv rl M:}Lnj'. lonmiias oi 
their o\m choosiau. 



C. Mechanism of Review 

There seems to he an almost limitless number of alternate mechanisms and 
processes for reviewing programs, lliese mu'clianisms range from rample 
single-step procedures (institution to the board) to elaborate multi- 
phase arrangements which may be intimately related to the entire state- 
wide master planning process. While there is no consensus as to tlie 
componer,,.^ j£ the review procoss, a typical approach might look like- 
the following: 

1. Intra-institutional Approval 

a) Originating unit identified a need 

b) Feasibility of the pro};ram is studied 
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c) Proposal is developed 
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U) Proposal is pivscnLi-d to ciirric-ulinn i i»nuni 1 1 (m/ 

Pri^posal is roconunoiuku! I)> comiMiri it) Lhr uluii m* sLr .1 iiM) 
AdniinisLrnt* Lon rc^vLcws propo.':al 

g) \clnunistraLiiMi suhinitii proposal to institutional board (il .nr > 

2. InLcr-iastiLuLioiial Appriwal 

a) Insti.tuLional administration r>ul»niLs Lhc proposal to an 
inLcr-insLiLutional conmiiLLco (or to lIjc foordinaLin}» staff 
which may rofor it Lo an inli»r-insLi f ul i onj 1 conimi lie*- ' . 

b) c omiTiit-Loo roviews and ruakos recommondati onr. i^ithiM- Lo flu 
coordinating agency oLafC i>r diivcLlv to Liu* bo.ird, 

3. Coord inaLinr, Af^^oncy Staff Review 

a) In^a nunhor of sLaL.-s L'ne insl i LuL u»n.s arc rcquin-d to stdMtn* t 
a "Letter of intent" Lo Lhe coordinaLim; aj'cncy aL a:- r iri> 
stage of the program development pnu'css, 

b) In a number of states ouLside consultaiiLs review Lhe prop<.sal 
and nvike recommendations (Lhey are usually selected joinLly 
by Lhe board staff and the institution). 

c) Coordinating agency staff reviews the proposals and Lhe 
process it has followed, priiaarily for procedural verifica- 
tion, and prepare:;: a recommendation ft>r the ht)ar(l. 

4. CoordinaLing Board Review 

a) The coordinating hoard reviews the reconunendaLj oiis oL: 

1) the inter-insLitutionai commiLtoe; 2) consulLauLs (if any) 
an'd ']) the board sLnff. 

b) Hie CoordinaLing board approves or disapproves ( reccnrancMids 
or noL recommends) the program. 

5. Post Approval I>rocess 

a) In a few states, there is a post-evaluation of the program 
after so many yoarr. or after one full proj^ram cycle has 
been completed. In states where Lhere is a posL-evaluaLion 
process Lhe criLeria of evaluaLion was generally doLermined 
by Lhe institution proposing the program as a part of Lhe 
approval process. 

b) In a few states, such as Idaho, Lhe review process is divided 
inLo Lwo phases. Phase I daLa is for planniur. Purposes. 
After a careful review of LhiS: phase by Llio division of 
Postseeondary KducaLion Curriculum Plannin;/ of the Office 

of tlie State Board of Kducation and \lv Academic Vice 
PresidonLs' Cnrriculum CommiLlrHs Lhe instiLuLion nay 

^''^^-^se 1 plan Lo Liu- SlaLe I5i)ard of i:dncatii)n 
y lor approval • 



If the Slato Board ot KducaLion (Jd»ilio) appmvc-s Lin- Pha.sc i 
plan, the insLitution nuy proceed with Lho more delai Lod 
Phase II ^'.ui-de 1 Liu^s. The Phase 11 proposal i.: reviewed 
by the Currienlum Committee, The Presidcnls' CouneiJ and 
the Division oL* Ourriculum rianniiij; he ion- suhniis:; ion Co 
Lho State Board oC F.dueation. Approval hy llic Board of 
Phase II would sipniCy approval ol the pro|)os(id program. 
Approval of Phar.e f does not necessarily insure approval 
of Phase II. 

Georgia utilixojj a similar process for graduate proj^rams 
wliieh is divided into three stages: i) exploratory 
discussions; 2) preliminary planninc. and i*val nation; and 
3) preparation and processing of the linal r.o:,.v'al. 
Thrse various phases are probably indie. iLivt . < Lho n(»ed 
for some inforuution at an earlier sta^*e for purpoju^s of 
planning and to conserve efforts in prot',ram development 
until those efforts are warranted on the basis of pre- 
liminary proj?.ram approval. 

Time i'Vamc for Approval ^ 

Tlie Icni^th of time required in the approval process varies in length 
from several weeks to several years. Exhibits 1 and 2 iAujvj two examples 
ef the program proposal and review process. In some statt^s such as 
Louisiana, Maryland and Virginia the occasions when programs can be 
submitted for review are specific (e.g., December I, ft^r approval of 
the coordinating board by July or in other states specific months such 
as May, October and December). la other states no specific hoard 
meeting has been designated for program approval making it possible for 
the institutions to submit proposals at any time. In some states the 
time allowed for agency nwiow is so short as to make a comprehensive 
review almost impossible. On the other hand in some states the proc(*ss 
is so long as to seem inhibitive. Tlie short period of staff review 

is offset somewhat if it occurs in a state which also requires a "letter 
of intent" or "advance notice". The "letter of intent" is generally 
required to be submitted during the initial planning stages at the 
institutions, thus providing Ihe coordinating agency wi t!i some advance 
notice for planning and review purposes. Stares osing letters of 
intent include M:iryland, North Carolina and Virginia. 

Inter-InstituLional Committee Review 

Most states which utilize the program nwicw process for new programs 
have some kind of an inticr-insti tutional committee or council, which 
reviews proposed programs at some stage of the review process, 'lliis 
committee typically consists oC the academic offici-rs of the institutionr:, 
and in a few instances c-nsisLs of various mixes of laculty (e.}u, houisiana), 
institutional presidents (e.g., Kentucky), board members (i.e., South Carolina, 
Mississippi, Maryland have standing board member connnitlees) and co- 
ordinating agency staff. ThcM-e w,is no sp^-oific nKMUio.i of shidenl 
membership on any of these f ntor- i n<. t i tutiona I rcviow comnii U ciS . 
In some cases the inter- i n-ai Uil iona I conunL tl r\pori:; dirrcLly 
to the coordinating boarj, in oth.^rs its ;ictii>n:. ^ur -iihcn l t» il 



ERIC 



1^ 



-12- 



U) the agency sL.iLT, 'i'lic j»r^Hip used by i;aii.s:us since \'ro') to m ^ \.\: > 
*;rams is [vrhaps typical of nuny. IL ccMisisis oJ t Ciuuk i ' o I'lu, i 
Academic MU'f Leer;; (COCAO) InMUcvich iiisl i t iU ioiu OLliet ,s( al( «. win' eh 
uLilLze this appreach include Alabama, fouisiana, Miniu-.soLa aiid Nortli 
Cai\> lina. 



Consul Lan>*s 



The use i)f ouLside consultants is a review mechanism utilized in at 
least nine states. In some states the institutions hire their own 
consultants during the institutional phase of prop.ram initiation. In 
other state s the consultants are selected by an inter-institutional 
connnittee or the coordinating agency staff. The rcMiiainin., ->tates wii '« 
utilize consult.'Mits use some kind of combination (^f the .J o .^rou| 
select the consultants, in most cases the names of the consultants 
their r.connnendations are provided for the information of the coordinating*, 
board at the time it takes final action on a propo::ed i^-oj^ram, Kentucky 
and Tennessee appear to make extensive use of consultants in j'.raduate 
programs. 

Dispostion by the Coordinatinr, Hc^ird 

In most states the coordinating board simply approves or disapproves 
tiie program (or recommends or does not recommcx.d it as appropriate to 
the agency's authority). In a few states the agency may take somc^ 
intermediate step giving tentative approval or approval with conditions. 
Other options include referring it back for further study or tabling 
the proposal for a period of time. In some cases where a program has 
not been approved, it may be re-submitted after a specified period of 
time . 



Post -Approval Audit 

In ten states there is some kind of a post approval review and evaluation 

process. In at least one state all approvals are tentative until after 

the post-audit. In some states the institution proposing tlie program 

provides the criteria for post-audit evaluation at the time the program 

is submitted. In other states there are proscribed criteria that each 

program must meet after a given period of timo. Hie exact period of 

time in which the post-audit evalu^ition is conducted varies, in some 

cases it is a specified number of years based on the program level 

(i.e., Bachelors, Masters, Doctors). In others it is conducted after 

the completion of the first full eyele of the program. Illinois uses 

outside consultants in its post evaluation as well as the criteria and 

methods of evaluation which were submitted when the pro/;ram was initially 
proposed • • - 

^11 • Review of Existing Programs 

A recent task force on statewide planning established by the Kducation 
Commission of the States noted that "during the decade of the %0s, the 
process of discontinuing programs in higher education at the statevvide 
level occurred rarely, if at alV\^ Future enrollment projections however 
clearly suggest the possibility In the future of "considerable consolida- 
tion, reorganization and curtailment" according to the task ioree report 
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Tlio roport goes on to suj'.jV'si tliat Llioio uuist In* .i tliMiMiiU !):r;ls 
phasinj» ouL or roorj;an rxlsLluj; proj\r:ims (Imii i .isnl ti.i' (Ik- 

roviow of new pro^u*ains, Tlu* ro!jowtn<\ l.icLor*; :Jio;ild ix' i on:, i L\'d 
aci*ording Lo tins roporL: *M) tlie niunboL' ol" t'.r.Klcj.Ur.s i roiii Lhe p7-(>^',iam 
in each of the lasL five year?;; 2) Llie lUiinher *)t .sUith nts enrol li tl in 
Lho proj;ram (enLr) and droponL rales); J) Lhe si/.e o| elnssc-;- iiui tin- 
Cost ol course^; Ldi'ntificd as inLej;ral elenwnt.s in the pro-,i im; cosL 
per proj-U'ani :;radiiaie; 5) lacuJl\ workload; o) pro^»rj!n f|iialitv .i:. r«»- 
ilecLed by Lis rej;ionai or nat'.onal repntation, facnlLy qnali 1 iea Li on:; 
and level of posiLion achieved by graduat.es o! Lhe proj;ram; /) toLal 
producLion of a program's graduaLi\s from all i nsLi tuLioni; ul t.iie stati*, 
reiuon and/or nation; 8) the economies and improvemiMiL s In cpiality Lo 
he aihieved i^y eiMisolida(:ion and/oi' elLminatien ol the |)ioj'ia'n; 9) i-.e.u ril 
stMd. nL inLore.st and demand trends for Lhe pro:»ram: and ; ht- ap- 

propriaLeness of t lu- proi'Tam Lo a chanj'ed Inst It uLiona I i. .>r niissiep / 

Fijxnre Lwo is an aLLempt Lo determine wliicli of the Len lactors suy^u'stetl 
in Llie I'XS repi)rr are acLuallv hei ni^ utili.zeil by Lhe varions r.tati* aj'.eneies 
fiM' Llie reviiVv' o\ c'xt;a«n- pr«"\r.Mns, This Loin|)aiison provich:; seiiu- iihM 
as Lo Lhe varii)us <M'oetdures i!;;i'd. However, iL alst> IiMVi'n oul r oiaer 
lacLors and proc eckiics whiLli ch'servr et)n.s i <lera t i on . In oidor Lo pro\ i«h' 
some inforntiLion on Lhi-sf i^Llu-r lactors, i^ acl) ol the proc ,. chi rt»:, \i:>k>k\ i)> the 
various sLaLi^s has been i;ummariziHl he 1 o\y lollowin", a hrirl ovorviox;. 

Programs Lo bo RevLc ' wecl 

As a cover letter from one aj-.ency staLcd, "Can 300 disciplinary areas 
in the system (not includinj^ all de^^rce levels) ho evaUiaLed I'f It'C t i ve 1 y 
and ef ficienLly 'Hie n\sponse from the sLaLes acLnally reviewinf; 
existing programs would seem to be an overwhelming "No". All die sLaLei: 
employ some kind of a screeninj; meclianism, ettiior arbiLrary ox 
wliich delineate:; Lh(» prot>rams suhj^cl to exiensive reviiw. In Sonlh 
Carolina Llie screening device w,is; "a very simph" test oC low aveiaj-.t- 
annual degree producLion", 

West Virginia utilizes a more elaborate system of review wliich requiri-s 
forced choices iuLo Lhree caLegoricr. tor each of LhrtM variabh:;. Sixty 
percent of flie progr^lms are regarded as n- riiui 1 on any giv« n variable, 
'iwenty percent are placed on eitli.'r side o( the normal range, 'fhe 
variables Lo he considered are cosL, i nsLi tuLionai priority, quality 
and output. IDach institution has its own niethod jor cs Lab J ishing lhe 
scale and determing the values Lliat are as:;igned to eacli oj Lliese 
variables. Using this procedure eaclj Instil uLion selecLs Lhe programs 
that should be studied in greater depth. 

Only a few sLaLcs, such as Wisconsin, liave attempLed a e(mipreh(Mis i ve 
review of all programs and tliis was done in stages by digree levrl. In- 
ginning with graduate programs. In Wisconsin, Liie review of masLer's 
and specialist programs began in 1972 and v/as romph led in .laiuiary. I07/|. 
llie review of doctoral programs and undergradnat i« programs is' curi-rnl 1> 
underway . 
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CriLcria for Review 



Tlie criteria for review of exisLing programs are prLimirLlv qiianLi tatively 
oriented In both the ''screening process" and in the extensive review of 
the programs identified by the "scrcc'ning process". The qualitative 
component, if it exists in the procedures, is gc.ierally tho responsibility 
of the institutions. For example, tlie Virginia Council for Higher 
Education refers to its program review as the "Quantitative Evaluation 
of Degree Programs" and states that "the institutions themselves bear 
primary responsiblity for the continuous evaluation of the quality of 
their curricula", 

lliis is not to say that the quality of programs is not taken into con- 
sideration. New Jersey's procedures and standards ot jud'uit.^nl which 
govern their review are described in a document entitled "Dcvelot>ing 
and Strengthening Graduate Programs in New Jersey State Colleges" which 
is based largely on the qualitiative standards developed by the National 
Graduate Council. In the case of New Jersey compliance with these 
standards is largely determined by outside consultants who have been 
jointly chosen by the institutions and the Department of Higher Education, 
New York has also used consultants in this way. 

In terms of other criteria, the components identified earlier in this 
report in the review of new programs are also used in the review of 
existing programs. In Wisconsin, for example, the major criteria examined 
include: a description of the program, program objectives, need, student 
demand, faculty-staff, curriculum, resources, facilities, finances and 
accreditation, the same general areas reviewed with regard to new programs. 

^fcchanism of Review 

The process of review, as mentioned earlier, generally consists of two 
phases. Tlie first phase is usually a screening process used to identify 
programs which are of questionable need, productivity, quality or other 
criteria. The second phase is the extensive review of tiie programs 
identified in Phase One. The extensive review is then studied by either 
the agency staff or by some inter-institutional committee. In some 
states the results of the review are merely made known to the agency, 
the legislature, the governor, etc., and the elimination of low quality, 
low productive programs is a voluntary one taken by the institution 
with the questionable program. In other states, generally those with 
governing and regulatory boards, the board itself makes the decision to 
terminate a given program. 
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D. Sunmiary of Procoduros {i'V Review of Kxiul 'in\i l*roj;rams 



llawaii (Univeisify of Hawaii) 

llie University oi Hawaii utilizes the same basic fornuxt for Liu* revi'(^v; 
of both new and existing progrvims. Established proj'rams are, by lioard 
of Regents policy, reviewed in-UepLh every fifth year, Kacli campus is 
responsible for developing a program review schedule with annual up- 
dates. Each review eovers, 1) program developments during the past five 
years, and 2) plans for the following six years on each applicable item 
provided in the system-wide guidelines. Reviews of particular proj^rams 
may be undertaken at any tinK^. deemed necessary by the facuhv, adminis- 
tration or board. 

Processing Procedures. Reviews flow from the department, division, 
institute or an equivalent unit chairman; to the college provost, dean 
to the graduate division; to the chancellors (vice presidents for 
community collep,es); to the university president Cor review and sub- 
mission to the cliairman of the Board of Regents for review by appropriate 
committees and for scheduling for formal action by tlie Board of Regents. 

Primary responsibility for setting pi;ogram priorities, developing new 
program proposals and evaluating existing programs, rests with the 
faculty, students and administrators at each campus witliin the university 
system. Within the broad system-wide policies and procedures oach campus 
formulates procedures for the review of new program proposals and 
for the continuous review of established program?;. 

System-wide Guidelines 

Introductory Summary Statement 

This statement should be as concise as possible, i.e., about three 
pages giving an abstract of accomplishments and of plans for the next 
six year period. It should include a summary of accomplishments and 
plans; specific objectives and need; relationship to system-wide, 
campus, and departmental objectives and plans; relationship to other 
programs within the system; actual and/or estimated enrollmi^nts 
(number and ratio state, foreign, mainland); job placements and 
job market supply and demand (numbers — state, foreign, mainland); 
actual and/or estimated annual operating costs and specific funding 
needs by year, e.g., total cost, PrE/sLudent cost, per student credit 
hour cost; revenue sources by years; CIP requirements; alternative 
plans if funding expectations are not realized; arguments for and 
against having the program at this University; and results of completed 
academic and other reviews. 

Details and Analysis 

This section provides guidelines for instructional programs and should 
be modified as appropriate for research and public service programs. 
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A. Objectives: 

!• Uliat proj;ram accomplishes or achieves. 

2. RelaLionship to system-wido , campus, collejve, and departmental/ 
divisioii/insLiLute objective and plans • 

3. Relationship to similar or reldted system-wide programs and 
fields of study, and acceptability for credits by other units. 
Justification for liaving a separate program. 

4. Historical development of the field and development of dcpart- 
menLal/divisional/instituLe strength. 

5. Need for program including state, national and LiiLi rnational 
aspects. 

6. Specific justification for the program at the University of 
Hawaii. Other institutions with such a program. 

B. Target Croup: 

1. Enrollments of student majors (not course registrations) by 
levels and concentrations. 

2. Origin of student majors by percentage (state, mainland, foreij;n). 

3. Service to student non**majors by programs, courses, and student ' 
credit hours# 

> 

4. Other distinguishing characteristics, e.g., economically 
d i s ad van t age d . 

C. Program Elements: 

1. Prerequisites for admission, e.g., course or degree and foreign 
language requirements. 

2. Options available (Masters A, B, and C.) 

3. Principal methods of instruction. 

4. Required and recommended courses (relationship to program 
objectives). 

5. Special requirements over and above regular minimum requirements 
of related programs. 

6. Relationship and impact of current programs to proposed; 
relationship of vocational to undergraduate, of undergraduate 
to graduate, and of master's and doctoral programs. 

7. Student credit hours, by levels, required to complete the 
program. 
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3. Student credit hours of insLructiou |>rovld<»d by lovoLs . 
9. Specific fields of emi>hasis or conceiurat i<MU 

10. Scimplc proj',rams if Lhore is fU-xibiliLy in offcrinj^f?. 

11. Examinations purformanco, written, aud oral — sequence and 
estimated time involved. 

12. nxpected end of program outcomes, compeLcncios of students, 
thesis and/or dissertation. 

I). Courses: 

1, Current, proposed, and projected courses wi Lli prerccjuislLos 
and instructors, 

2. Relationship of courses to program specifically indicating 
which provide background for any concentiMtion. 

3* Plans for modifications of courses including consolidations, 
additions, and deletions, 

4. Relationship between undergraduate and graduate course 
sequences. 

E. tfeasures of Program Effectiveness: 

1. Average length of time full-time students complete program 
requirements. 

2. Percentaj^e of students that complete the program annually. 

3. Professional examination or other requirements for employment, 
e»g.| percentage goal of graduates co pass profcssi<mal 
examinations and percentage goal of placement of graduates in 
the field. 

4. Types and results of accreditation rev Lews. 

5. Criteria, results and plans on evaluation of faculty. 

6. Results and plans on student counseling and advising, i.e., 
faculty role. 

F. Discussion on Alternatives: 

1. Alternative means to mc»et objectives and needs, advantages 
and disadvantages, and unit and total ^osts. 

2. Specific reasons this program considered the best alternative. 
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G. Personnel Requirements: 

!• Faculty, including pending appoinLments — names, ranks, position 
count, professional qualifications, and total publications. 
(Tor ^;raduato programs, include experience faculty have had 
guiding theses and/or dlsucrtations sample of tliescs and/or 
dissertations for which faculty served as chairman, and 
master's and doctoral theses completed.) 

2. Relationship of faculty qualifications to program objectives. 

3* Past and current r">sitions, position counts, and costs of 
administrative, faculty, graduate assistant, Icctur'T, and 
support personnel. 

4. Proposed new positions, position counts, and costs for ad- 
ministrative, faculty, graduate assistant, lecturer, and 
support personnel over the next six years. 

5. Current and planned faculty mix by rank. Overall average 
faculty salaries. 

6. Tenuring plans for faculty, i.e., categories and percentages 
by rank. 

7. Past experience and plans for providing faculty with additional 
compensation besides regular compensation, 

8. Current and proposed faculty work assignment guidelines, e.g., 
minimum and average class sizes, student/ faculty ratios, 
minimum and average weekly instructional contact hours, 
minimum and average semester credit hours, levels of courses 
to be taught concurrently, i.on-compensated research and public 
service expectations in average hours per week, products or 
services, and puhlisiiing or exliibiting results. 

9. If no fundf- being requested, source of faculty and support 
resources. 

10. Shared or split appointments of faculty and staff with other 
programs or activities. 

11. If graduate program, impact upon undergraduate instruction, 
i.e., type and student credit hours of undergraduate courses 
to be taken. 

12. Faculty development -program and plans. 

H. Financial Requirements Other Than Capital Costs: 

1. Costs for: 

a. Supplies and other current type expenses. 
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b. Equipment include a list of available equlpnient and 
required additions. 

•c. Campus services. 

d. Building operations and maintenance. 

e. Student services 

f. Computer services 

g. Libraries include list of journals with dates, current 
holdings, and required additions — note consultation with 
Library. 

2. If no additional costs projected, source of required resources, 

3. Shared resources with other program or activities. 
I. Student Costs: 

Excluding CIP, actual and estimated cost per student credit hour, 
per FTE student major by level of instruction, per graduate.' 
Comparison with other similar programs within the System. 

J. Capital Improvements (CIP): 

1. Additional space or facilities required, specific program 
justification, estimated costs, and desired time schedule. 

2. If no additional CIP, amount, source, and justification for 
required additional space or facilities, including alterations 
or renovations, estimated costs, and desired time schedule. 

3. Plans to accommodate activities to be displaced from existing 
space or facilities. 

4. Shared space and facilities. 

5. Present and projected library facilities for the program — 
note consultation with Library. 

K. Program Funding: 

1. Types, amounts, and source, legal reference or authorization 
for each type of program funding, i.e., general, federal, 
special, foundation. 

2. Plans if non-state funding decreases • 
L. Further Considerations: 

1. Special problems or expected developments. 

2. Other significant issues. 

27 



Wisconsin (University of Wisconsin) 

TIio UniversiLy of Wisconsin has coiulucLed (or is conduct Inj;) a comprehensive 
audiL and review of all existinf» academic programs. 'Ilio nuisters and special- 
isL program audit and review war? completed in January, I97^i. At that Lime 
the review of doctoral programs was delegated to UniversiLy of Wisconsin- 
Madison and UniversiLy of Wisconsin-Milwaukee. An undergraduate review has 
now been initiated. Tlie following statements about the review process 
are based on the process established for the review of undergraduate 
programs but is generally consistent with that developed for programs at 
other degree levels within the UW system. 

In delegating the task of audit and review to the institutions, the central 
administration seeks to recognize fully that the health of Liie academic 
offerings of each institution is a primary responsibility o£ it.s faculty. 
For this reason, each institution was asked to develop those procedures 
which it judges best adapted to its form of governance, and most likely 
to accomplish the goals established. Tlie involvement of the central ad- 
ministration in the process will be limited to: a) the distribution of 
the general guidelines; b) the verification of the fact that the process 
and procedures undertaken by the institutions meet the expectations of the 
guidelines; and c)'the receiving of campus reports to the end that the 
consequences of the process can be made known to the Regents, and that 
the effective practice developed by one institution can be communieaLed to 
others. 

Definitions and Goals 

The general intention of audit and review of established undergraduate 
and extension programs is that of enabling institutions of the System to 
provide for students the most effective range of academic offerings 
possible within their available resources. Within this general intention, 
certain specific purposes need to be highlighted: 

(a) The establishment in each institution of a method or methods for 
V identifying from the total spectrum of programs those which should 

receive thorough review by the faculty and institution in a particular 
period of time. One of the methods which should be used for such 
identification is that of audit . An audit is the examination of each 
academic program in terms of a limited number of readily quantifiable 
indicators of the conditi on of the program, 

(b) The establishment in each institution of a procedure for reviewing 
in depth the condition of any program identified for sucli intensive 

reexamination. The review is a judgmental process which uses information 
provided in the audit, plus additional relevant infonuation or analysis, 
to reach a judgment concerning what steps, if any, should be taken relative 
to the program receiving -eview. Decisions to strengthen, consolidate, 
reorganize, or phase out a given program could ba logical consequences 
of an intensive review. 
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(c) Developing through (a) and (b) an on-goinp, process of audit and re- 
view at the institutional level which assures tliaL each insti Lul ioii, 
as part o£ its continuing responsibilities, has in operation procedures 
which will assure continuing audit and review of established programs, 
identification of problems, and deliberations leading to decisions as 
to how these problems may be met. 

Of the three specific purposes identified, the last, (c), is the one 
having the most important consequences • The specific audit and review 
process now undertaken should lead deliberately to establishment of an 
on-going process at each institution, including establishment of the 
criteria and procedures. 

Audit Procedures 

Emphasis should be given to the fact that an audit does not create a 
presumption that the programs selected for intensive analysis are in fact 
in trouble or headed for trouble. The indicators used for audit purposes 
may suggest this, but more intensive analysis may lead to a quite 
different judgment. 

Emphasis should also be given to the fact that an audit process should 
not be the exclusive means of identifying programs which should be 
given a more intensive analysis. For a variety of judgmental reasons, 
administrators or planning committees for a particular institution 
might ask for more intensive review of a program which had not been 
selected through the audit process. For example, the anticipated 
retirement or departure of key faculty members in a given program 
might create a presumption that review of the program should be under- 
taken prior to restaffing; or a regularly scheduled site visit by an 
accreditation team might catalyze an institutional audit and review of 
a program in conjunction with the preparation of documents for the 
visitors; or planning studies concerning the minimum staffing which 
should be maintained for the essential programs of an institution 
might generate need for review of particular programs; or recommendations 
from system-wide or institutional task forces on curriculum changes 
could also generate need for program review. The point to be made is 
that an audit procedure will support an on-going process of review, but 
is not the exclusive means of generating reviews. 

The specific purpose for establishing an audit procedure is to make use 
of a few accessible and objective indicators to single out programs 
that may need special attention. Once such indicators have been identified, 
it becomes relatively easy for an institution to select the set of programs 
needing more intensive analysis* In this sense, an effective audit 
procedure makes possible the identification of those programs which 
should receive immediate attention. 

Audit Indicators 

The following indicators are among those variously identified as potentially 
useful for purposes of an audit of an undergraduate program: 
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(a) A five-year liistory of numbers of majors, numbers of graduates, 
numbers of FTE stuJcnts tauj^hl, and numbers of faculty relative 

to majors and FTK sLudonts. 

(b) Class size and studcMit distribution by lovel, 

(c) Cost per studonl crodil hour of instruction, 

(d) Comparison of data concerning a given program with data for the 
department offering the program as a whole; witli otlicr programs 

offered by the department; or wltli other programs in the division 
within which the program appears, 

(o) As available, information on persistence of students within the 

program; student satisfaction with tiie progr.im; and experience 
of graduates from the program. 

It is understood that each institution will establish criteria to 
be used in auditing, as well as tlie procedure by wliich information 
gathered in tlie audit is used to select programs to receive additional 
study. University l-x tension and the Center System will need to develop 
indicators appropriate to their programs, 

Reviow Procedures 

Intensive analysis of programs selected through audit or identified 
by other means will be carried out by the institution, using procedures 
which they find most suited to their faculty and administrative 
structures. This will normally involve a thorough study of the program 
at the departmental or other appropriate level with a report on its 
status to the institutional committees couducLing the review. The 
format for such a report should be AC7S-J, i^'ormat #A (see Appendix A), 
modified by tlio instituion, if necessary, to best meet specific 
institutional program review needs. 

Institutions .identifying a Lirge number of programs for review as a 
result of an initial comprehensive audit may find it necessary to 
have intervening procedures which select only a portion of these 
programs for immediate review. Such procedures may Include preliminary 
discussion of audit data with tho dcp«irtmeiit or the introduction of 
additional infomiation by the depnrtment which would materially affect 
the significance of the audit data. Those programs whicli continued 
to indicate problems would receive higliest priority tor review. 

The institutions shall specify the procedures by which programs will 
be reviewed and the criteria upon which judgments will be reaclu^d. 
This will be followed by the notification of subse<iuent actions which 
will be taken relative to the programs reviewed. 
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Wisconsin (cont . ) 



Reporting 

By February 1, 1975 each institution shall report to Central Administration, 
Academic Affairs, its plans for undergraduate or extension program audit 
and review, including*, a statement of the criteria to be used in audit, the 
process to be followed in selecting programs for review, and the procedures 
and decision-making process to follow program review. 

By June 1, 197 5 each institution shall provide to Central Administration, 
Academic Affairs, either an interim or final report on its undergraduate 
or extension program audit and review. If the report is interim in 
nature, each institution should specify its timetable for completing the 
initial cycle of audit and review. The June 1 report should also include 
a description of the *'on-going process of audit and review" developed 
by the institution. Academic Affairs will summarize these interim or 
final reports in an information report to the July, 1975 meeting of 
the Board of Regents. 

Institutions projecting completion of the current cycle of audit and 
review in 197 5-76 should provide a final report at the completion date 
specified in their interim report. Academic Affairs will provide the 
Regents with summaries of these final reports as they become due. 

Graduate Audit and Review 

As previously indicated, the doctoral audit and review was delegated 
to the UW-Milwaukee and UW-Madison institutions in spring, 1974. 

At the time of this delegation, the Graduate School of UW-Milwaukee 
had established a continuous process for intensive review of all 
graduate programs on a five-year cycle. As a result of this process, 
all doctoral programs have either been the subject of or are presently 
scheduled for review by the graduate faculties, using external examiners 
in each case. A summary report on the UW-Milwaukee procedures, and 
the determinations made to date on the basis of these procedures, is 
appended as Appendix B. 

The Graduate School of UW-Madison has initiated audit of all existing 
doctoral programs for the purpose of identifying programs for which 
complete review will be conducted over the next four years. A summary 
report on the audit procedures, the factors considered, and the projected 
annual schedule of the review process, is appended as Appendix C. 

In the University Cluster, several graduate programs were identified 
in the master's/specialist audit and review exercise conducted earlier 
this year as requiring regional/consort ial review. These regional/ 
consortial reviews will be conducted by the appropriate set of regional 
campuses and their procedures, process and criteria will be submitted 
to Central Administration, Academic Affairs, as soon as developed, 
including the time schedule for review. The final report on this aspect 
of the master's/specialist audit and review will be prepared for 
the Board of Regents in July, 1975. 
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ACADEMIC PROGRAM FORMAT #4 December, J 974 

University of Wisconsin 
REVIEW OF EXISTING ACADEMFC PROGRAM 

I. DESCRIPTION 

1. 1 Kxnct Designation; 



1*2 Department or Functional Equivalent ; Department of 

J or Functional Equivalent with members 



repre^sonting Departments of 



1*3 School. C ollege or Functional Equivalent ; School or College 

— ; or Functional 

Equivalent 

1.4 Unit r, University of Wisconsin - 



Current Area(s) of Concentration ; Specify the current areas 
of concentration in the program, 

1*6 Program C hanges Planned : Wliat changes, if any, are planned 

in the program during the next several years? (Be specific). 

II, PROGRAM OBJECTIVES 

Statement of Program Ob jectives ; This program is designed 
to accomplish the following objectives; 

2 • 2 Relations hip to Existing Unit Mission and Academic Plan ; 

Describe, including relationship to existing department (s) 
or functional equivalent, 

^•3 Closely R elated Unit Programs and Areas of Strength ; List 

other closely related programs or areas of strength currently 
offered or planned and describe the effect of this program 
on them. How do related programs and strengths in other 
academic areas support the proposed program? 

Changes in Program Objectives ; What changes, if any, have 
occurred in program objectives within recent years? 

^•^ Anticipated Change s in Pro^ram Objectives ; What changes, if 
any, in program objectives are being considered for the near 
future? 

III. NEED 



^•^ Sitnilar Programs Elsew here in Wisconsin ! List similar programs 
and the names of institutions (public and private) offering 
the same or a similar program. 

3*2 Location of Nearbv Similar Programs Outside of Wisconsin ; 
Names of institutions and locations. 




This format will be modified as experience leads to higher levels of 
sophistication and demonstrates a need for adapting to variations in 
institutional and programmatic complexity. 
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Wisconain (cont,) 



3.3 Relationship With Other Programs ; Arc there precedents, 
previously endorsed program plans, or major existing • 
curricula in a related area which bear on this program (Explain). 

3.4 Justification for Program Continuation ; Specify area, state, 
or national need for graduates. Provide placement data; in- 
cluding, geographical distribution, job level, and occupational 
title, for at least the previous 3 years. Cite any pertinent 
studies or data. 



3.5 Outside Interest in the Program : Identify interest on the 
part of local groups, industry, resrearch centers, other 
educational institutions or state agencies. Indicate the 
nature of contacts made with these groups and the. resultvs of 
these contacts. 



IV. STUDENT DEMAND 



4.1 Enrollment Statistics ; Provide enrollment statistics for the 
past four years along with present enrollment and enrollment 
projections for the future. Indicate declared majors (degree 
candidates) for levels II, 111, and IV for the past four years. 

4.2 Anticipated Effect on Enrollment of n Similar Program : If a 
similar program were authorized at another University of 
Wisconsin Unit, what would be the anticipated effect on 
program enrollment? 

4.3 Degrees Granted ; If a degree program, how many degrees have 
been granted through the program during the prior 10 years? 

4.4 Follow-Up and Student Placement : Provide as much information 
as possible with respect to former students in the program 
(placement information, continuing degree work, etc.) 

4.5 Enrollment Capacity : What capacity does the program have 
to absorb additional enrollment without significant added 
cost? Please indicate rationale. 



4.6 Anticipated Changes : Provide information on anticipated 
changes in program size. Give data to justify estimates 
of growth or decline. 



V. PERSONNEL (FACULTY-STAFF) 

5.1 Faculty Who Are Direct Participants in the Program : Attach a 
list of present departmental faculty who are involved in the 
program, including date of appointment, present rank, highest 
degree and granting institution, and other pertinent information. 

5.2 Support or Advisory Faculty : List faculty, including those 
in other than the sponsoring department, who are involved in 
supporting or advisory roles. 



5.3 Current Support Staff : Provide the number and position titles 
Q of current support staff used in the program. 
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Wisconsin (cent.) 



5.^ Special Compotencios of Existing Faculty : Indicate areas 
of specialized competence as demonstrated by research or 
prior experience. 

5. 5 Strengths or Specialties Not Existing in Present Faculty ; 
Wliat strengths or specialties not possessed by current 
faculty would be desirable to improve the program? 

5*6 Anticipat ed Changes : Wliat staff losses or additions are 
expected and how will they affect the program? 

VI. CURRICULUM 



Course L isting ; List departmental courses for the program 
in class sequence and give a sample course spread (including 
non-departmental prerequisite and required courses) for an 
appropriate period of time. If new courses are to be offered 
in the next year, please include a separate list of such 
courses. What courses have been deleted or substantially 
updated in past five years? 

^•2 Strengths /Unique Features : Describe any special departmental 
strengths and/or unique features of the program. 

^•3 Departmen tal Deficiencies and Planned Remedies : Describe 
any departmental weaknesses or deficiencies, along with 
plans for eliminating these (include expected timetable.) 

^•^ Mediated I nstruction (if any) : Is any of the instruction . 
delivered via media? If so, please describe. If not, do 
you plan to develop any instructional media? (Specify). 

^•5 Interrela tionships with other Curricula ; Wliat other programs 

within the institution make use of instruction provided through 
this program? Describe. 

^•^ Anticipated Changes: Describe curricular changes planned for 

the program which would affect its enrollment, staffing or costs. 

VII. INFORMATIONAL RE SOURCES /LIBRARIES 

^•1 Library Resources: Wliat are the special strengths in available 
library resources as they relate to the current program? What 
is the departmental library budget? 

7.2 gpecial Resources; What, if any, special informational resources 
(slides, tapes, etc.) are used in the program? Provide an 
inventory. 

7.3 Correcting Resource Deficiencies : If library or special 
resources are insufficient, what plans have been made to 
correct these deficiencies? 

VIII. FACILITIES - EQUIPMENT 

O ^-1 Current Facilities and Capital EQuipmGnt : List facilities such 

ERJC as classrooms, laboratories and fixed movable equipment (over 

mamam $100 m value) currently available and used in the program. 
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Wisconsin (c^nt . ) 



^•2 Needed Additional Facilities ; Wfiat additional farilitics, 
iC any, are needed In order to Improve the (|iiaiity of the 
program being offered? List any such items proposed for the 
next two bioniiia and provide a cost estimate for eaeh bienniiim. 

Needed Additional Equipment : Wliat additional fixed and movable 
equipment, if any, is needed in order to improve Lhc quality 
of the program being offered? List all items proposed for 
the next two biennia and provide a cost estimate for each 
biennium, 

FINANCI- 

^•1 Total Program Costs ; Using the attached chart, calculate 
the total costs for the program, 

^•2 Percent Breakdown by Instruct ion/Research/Publ ic Service : 
Estimate the percentage of total program time in the areas 
of Instruction, research and public service. 

9- 3 Student F inancial Aids ; List financial aids available to 
students in the fonn of scholarships, fellowships, etc, 
and the sources of these aids. Include available dollar 
amounts in the appropriate space on the attached chart, 

ACCREDITATION 

10* 1 Accreditation Status; If accreditation has been attained 
please provide name of accrediting agency, date accredited 
and periodicity of accreditation. If not accredited, 
outline plans for attaining it. 
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Wost Virginia (Board of Regents) 

The West Virginia Board of Regents last revicv^cd programs in 1972 and ir> 
now in the process of reviewing all existing programs that have been in 
operation a prescribed number of years plus new programs which need approval 
for starting in 1975 and 1976. 

According to Regents policy, programs are reviewed according to the following 
schedule : 



The review process will occur in two stages. The first stage will sort 
programs into two categories: 1) those that need a more exLcMinive review; 
and 2) those that do not. The second stage will be the more extensive 
review. The first stage is scheduled Lo last about thirty to ninety days 
and should be completed by May 1, 1975. 



STAGE I 



Tlie variables to be considered are cost, institutional priority, quality 
and output. It is recognized that each institution will have its own method 
for establishing the scale and determining the values that are assigned to 
each of these variables. In some cases, the procedures used are quite sub- 
jective. In others, there is a greater attempt toward quantification. 
Although there is no attempt to require uniform methods at separate institu- 
tions, the board expects to receive background information on institutional 
procedures for rating these variables. 

The purpose of the initial stage of the review is best met by requiring 
forced choices into three categories for each of these variables. Sixty 
percent of the programs should be regarded as normal on any given variable. 
Twenty percent should be placed on either side of the normal range. Funds 
other than State-appropriated funds distributed on SCH basis may be a signifi- 
cant factor in a program. In such cases, this should be noted and specifically 
taken into account in the decision to request review or not. Using this in- 
formation each institution will select the programs that should be studied 
in greater depth in order to determine whether action to Inititate or term- 
inate is desirable. Also, the Director of Academic Affairs may place programs 
on this list. 

Tlie number of programs which should be selected for in-depth review will 
relate to the size and to the rate of change of the institution. ITie pro- 
grams which are selected will, to a very real extent, control the nature 
of the development for the institution during the next few years. Therefore, 
it is critical that the review incorporate an analysis of faculty utilization 
or needs for each program. This will require arbitrary distinctions bet^7oen 
faculty contribution to the program and faculty effort that is more properly 
classified as service or general education. Although the estimates of FTE 
faculty per program will be inexact, it is desirable to n^ake a reasonable' 
effort to understand the relation between the program and the number of 
FTE faculty required for its operation. When contemplated changes in the 
size or quality of a program will cause a change in the number of faculty 
required for the program, that change in number of faculty also should be 
recorded in the institutional report^i^ 
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Wi-Ht Virginia (oont.) 



For purposes of this review, some institutions will deal wiLh programs in 
subgroups ratljcr than attempting a comparison of ail programs in the insti- 
tution. An example of useful subgroups might be associate, baccalaureate, 
master's and doctoral level degree programs. Another type of subgroup 
might be by funding formula (i.e., nursing, engineering, etc.). In any 
case, it may be useful to recognize that the definition of normal will vary 
and that groupings should be selected to make comparisons in the most meaning- 
ful and useful manner. Indeed, in some instances a group might consist of 
a single program (law or nursing). 

Tlie attached Exliibit A gives a suggested format for summarizing information. 

STAGE II. Program Review (Early Tliinking About the Second Stage) 

The second stage will begin immediately after identification of new programs 
and programs requiring more intensive review. Hopefully, this will start 
early in January. 

The overall thrust of the second stage is to clarify the choices and to 
relate these choices with their consequences'. Program change, either 
through evolution or through addition-deletion, is a necessary development 
in the overall higher education system of West Virginia. At the institution 
level, program change gives one of the clearest evidences of the institution's 
relation to its mission in the State. Therefore, the decisions regarding 
addition, deletion or change of programs will be a highly significant factor 
in the development of each institution and the system as a whole durinjs the 
next two years. * 

The number of faculty in the total state system is a major determinant for 
the number of areas where a program or programs can be offered. The greater 
the number of faculty, the greater the number of distinct programs that can 
be staffed. The converse also iy true. Therefore, the review will be tied 
closely to the number of faculty which is expected in the system during the 
next few years . j t, 

Through discussions with each institution plus analysis of budget and enroll- 
ment data, a determination will be made regarding the number of faculty each 
institution is likely to have during the next two years. Given this number, 
each institution will be requested to answer the following questions about 
new programs which are being requested and the old programs selected for 
review. 

1. What are the consequences associated with whether or not this 
program is offered? 

2. If it is offered, what changes are expected during the next two 
years and what are the conditions for its continuation? 

3. Ffilate the number of faculty expected for your institution to the 
choices for adding or deleting programs. 
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Loulsiana (Board of Regents) 

Effective January 1, 1975. the Louisiana Coordinatinj; Council for Higher 
Education bocomo the Board of Regents. Previously, the Coordinating, 
Council was authorized to review existing programs and make recommendations 
regarding them to the governing boards of the respective institutions • 
This was done only in the case of graduate programs, in which sotwe preliminary 
work was done in the development of and application of evaluative criteria 
for graduate education. 'Hie preliminary work is described below^ 

Preliminary Guidelines. 

Pursuant to an assessment of existing graduate programs, the role of 
graduate education must be fixed firmly in the minds of evaluators. Hie 
accepted role is fourfold: 

1« The education and development of skilled individuals; 

2^ The production of knowledge; 

3« The preservation and transmission of knowledge; 

4« The improvement of the quality of life. 

Evaluation must proceed with care to demand excellence and accountability 
at the same time protecting the role of graduate education. 

The next step in the evaluation to date is to develop criteria based on the 
experience of other states and agencies to present to the institutions, the 
Academic Affairs Committee, and the Council for their consideration. Three 
broad areas have been identified for examination; 1) productivity, 2) 
quality, and 3) duplication. One criterion has been identified as useful 
in each of these areas, 

1. Productivity - At least six graduates in the past three years, 
(Source: studies and evaluations in other states,) 

2, Quality - At least five teriuinal degree holders on the faculty 
of any department offering the doctorate, and at least four 
terminal degree holders on the faculty of any department offering 
the masters, 

(Source: minimum recommendations of tlie National Council of 
Graduate Schools re faculty preparation and numbers,) 

3* Duplication - The number of programs which constitute duplication 
may be dependent on the discipline involved. It is generally 
accepted in studies in other states tliat, with the exception of 
teacher education at the masters level, a graduate program should 
serve a slate (preferably regional) need and two programs constitute 
duplication. 
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Plans regarding a timetable may be ambitious, but it is hoped that 
program information can be presented to the Academic Affairs Committee 
in November for consideration of appropriateness of criteria, quanti- 
tative data, and written justifications. Next, the institutions will 
be called on aga^*^ for additional information and justification as neces- 
sary. And finally, an Academic Affairs Committee report v/ith recommen- 
dations will be offered at the Council in January. 



Arizona (Board of Regents) 

The Arizona Board of Regents do not have guidelines for the review of 
existing academic programs. A set of guidelines which outline the 
Arizona University System's plan for review of existing programs is in 
the process of being developed. Hie information below has been abstracted 
from some preliminary documents. 

Preliminary Guidelines. 

In the continuing responsibilities for long range planning, university 
and staff peronnel were charged with "establishing basic criteria and 
standards under which undergraduate curricula and graduate programs 
will be reviewed . • 

It is established that periodic program review is desirable to strengthen 
existing programs and to eliminate or upgrade those which fail to meet 
acceptable standards. It is useful to examine answers to questions from 
which review outlines can be developed for assessment and evaluation by 
the universities and the Regents. By deciding upon periodic review using 
a set of criteria or guideline questions agreed upon by the universities, 
the Board can examine, through university-appointed internal committees 
and external consultants requested from an independent agency, CGS, how 
programs within the university system measure up to other programs in 
regional or national universi^:ies. The process sug ,ested reserves many 
judgments to faculty, and the standards are detern^ned by faculty and 
outside consultants. At the same time, the Board can assess the perfor- 
mance and achievements of faculty and stuc-nts. The questions raised 
fall into five classifications: 1) program, 2) faculty, 3) students, 
4) physical facilities and other resources, and 5) cnst and production 
data. Although the proposal has been regarded as expensive by at least 
one of the institutions in the university system, the cost of not for- 
mulating objective judgments concerning the quality and effectiveness of 
programs is over the long term extretnely high both in terms of state resources 
devoted to programs and in terms of the graduates of the program who are 
ill-educated or under-educated. Tt.e attached list of Questions needs 
refinement and expansion, but they do reflect what othJr Boards are asking 
of their universities. (See Exhibit B) 
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Virginia (State Council o£ Higher Education) 

Iiach year the State Council of lliglier Education must review a subs tant Lai 
number of roquej5Ls to plan and initiate new degrcu' proi»rams dL Virj^iuin's 
state collei^es and universities. Integral to tho. review and approval 
process is the Council's concern that proposed programs should be 
productive and not unnecessarily duplicative of programs already in 
operation. To detennlnc the need for proposed and existing programs, 
the Council usually studies enrollments and de';rocs conferred throughout 
Virginia, along with regional and national manpower lequirements and 
training statistics. Existia;', degree programs will he evaluated by 
assessint^ tne number of o^'grees conferred or by reviewing data on 
student enrollment. 

The Council undertakes the quantitative evaluation of degree programs with 
full awareness that qualitative evaluation of these programs is at least 
as important. The Council believes, however, that the institutions of 
higher education themselves bear primary responsibility for the continuous 
evaluation of the quality of their curricula . Through its quantitative 
:»valuation of degree programs, the Council will help to ensure the 
accountability of Virginia state-supported institutions of higher education 
to the citizens of the Commonwealth. Although it is primarily a responsi- 
bility of the institutions themselves to ensure that high standards are 
met by the degree programs they offer, the Council will request the 
institutions to develop procedures for the qualitative evalu<!tion of 
degree programs, placing particular emphasis upon graduate programs, 
but eventually providing for the evaluation of undergraduate and com- 
munity college programs. 

Definition of a Degree Program 

To get a proper frame of reference for the evaluation of degree programs 
by auditing degrees conferred (or program productivity), it is necessary 
to define a degree program. 

For the purpose of evaluation, a degree program is defined as an area 
of specialization (major) for which recognition is intended to be given 
by the conferring of a degree. The following factors will be taken into 
consideration in identifying a degree program: 

1. Program Nomenclature: The title by which the area of .specialization 
is identified. 

2. Program Classification Code: The code number under which degrees 
conferred are reported on the U.S.O.E. Higher Education General 

Infomiation Survey, Form 2300-2.1, 

3. Degree Level: The levels of the degree awarded, e.g.. Associate's, 
Bachelor's, Master's, or Doctoral. If a program (major) at any 

level has several degree title options, such as MA, MS, MAT, the number 
of degrees are recorded in the aggregate as reported under the program 
classification code, ^ 
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Virginia (cont.) 



For example, a major in Biology (general) may have several master's 
degree options such as MA, MS, MAT, and MEd, Kach option, liowever, 
should have the program classification code of 0401: Biology, general. 
All degrees conferred ia that mnjor would he reported on the Higher 
Education General Information Survey (HIDGIS) of the U.S. Office of 
Education, The Council would review degree productivity by using 
O.E. Form 2JOO-2,l: De^roes and Other Formal Awards Conferred . Page b, 
Line 53. 



Degree Productivity Criteria 



^ The first step in the evaluation of a degree program productivity 
should be its record of graduates. This will be determined by the 
tabulation of degrees conferred each year and the average per year 
over a period of several years. The measure of degrees conferred will 
Lake three factors into consideration: program start-up time, annual 
productivity expectations, and long-term productivity. 

1. Allowance will be made for program start-up time. The Council 
recognizes that a certain amount of time must elapse for students 

to complete the requirements' for a degree, and for a program to 
develop and gain acceptance. This time span varies according to 
degree level, program nature, and whether the students are part-time 
or full-time. The following allowances will be made before programs 
come under evaluation; 3 years for associate degrees; 3 years for 
bachelor's degrees; 2 years for master's degrees; and 4 years for 
doctoral degrees. At the end of each time period, the State Council 
of Higher Education will begin to monitor program degree productivity, 

2. According to program level, a certain minimum annual average number 
of graduates will be expected. These numbers are: 10 associate 

in arts and associate in science degrees; 7 associate in applied science 
degrees; 5 bachelor's degrees; 3 master's degrees; and 2 doctoral degrees. 
Productivity will be reviewed each biennium, covering the preceding 
five years where possible. The five year average will be used to allow 
for year-to-year fluctuation in the number of graduates from a specific 
program. 



Service Criteria 



In the event that any degree program has less than the number of graduates 
established in the degree productivity criteria, the staff of the State 
Council of Higher Education will consult with institutional officers 
regarding other justifications for continuation of the program. Should 
an institution wish to continue a program, despite few graduates, it 
will be provided the opportunity to justify such a program by showing a 
"service" function from data reported on the Council Form A-1; Resid ent 
Classes Taught by Term . 

1. Justification of a program on the basis of "service" would be 

determined from the Full-Time-Equivalent Student (PTES) enroll- 
ment for regular session, or smmner session under special circumstances: 
13-22 lower-division FTKS, for Associate In Arts and Associate in 
Science degree programs; 13-17 lower-division FTFS, for Associate in 
^ Applied Science degree programs; 10-14 upper-division FTKS, for Bachelor's 

ERIC '^^^''''^ programs; and 8-12 first-year graduate FTES, lor Master's degree 

y^g^^ programs, 



2. In the ovent that any Doctoral degree program has li»ss than the 
number of graduates osLablished in the numerical criteria, an 

Institution might propose a jus tiricalion of the program on the basis 
of organized and sponsored research projects utidcrway. 

3. A non-productive Master's degree program which is carried along 
with a Doctoral program, may be '^L^lagged", or removed from the 

list of non-productive programs. Tn this case, the productivity 
criterion will not be applied. However, at Llic same time then, the 
Council will remove that program from the inventory used in preparing; 
the biennial budget for library holdings. 

4. The Council will give special consideration to low-productivity 
interdisciplinary programs, which are composed of Cdnrscs from 

other (ilscipiinary programs rather tiian no.w courses. 



Procedure 



The biennial program evaluation will bo initiated by the staff of the 
State Council of Higher Education and be ro:ukicL**d in the following 
manner: 



1. Composite tables of degrees conferred will be prepared from previously 
verified data and each institution's report of Dej>ree3 Conferred 

(O.E. 2300-2.1): by degree level; by program classification code and 
nomenclature with cross-check on each institution's inventory of approved 
programs . 

2. Draft tables will be sent to each institution for vertif ication of 
new data and comment on any discrepancies or irregularities. 

Council staff will confer with institutional administrators on any 
problems that might be identified. 

3. A questionnaire will be sent to the appropriate institutional 
administrative officer for any degree program that falls to meet 

the established degree productivity criteria. Other factors that ought 
to be considered should be identified at this time. 

4. Council staff will consult with institutional administrative officers 
on the questionnaire responses and Llie action to be taken on each 

program in question. 

5. Council staff will report the evaluation results to the State Council 
of Higher Education for Virginia for its Information or recommended 

action; e.g,, continuation, probation, termination witli adequate phase-out 
t ime . 



6. An institution will be given the opportunity to appeal a Council 

decision under the same conditions as prescribed in the Council's 
Policy and Procedu res for the Approval of New Deuree Programs . 
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Vormont (Vermont State Colleges) 

The Vermont St^ite Colleges are currently in the process of developing 
criteria for the review of existing programs. Preliminary plans call 
for the inclusion of the following criteria: 

1. program costs, 

2. enrollment trends, 

3. degrees conferred trends, 

4. duplication of programs, 

5. programs in light of program priorities (i.e., career programs 
will have higher priority than academic degree programs), 

6. placement and employment trends. 

It is anticipated that program cost will be the most difficult to obtain. 
An effort has been launched to obtain costing information based on 
Program I category in NCHEMS structure. 

Nebraska (University of Nebraska) 

The University of Nebraska, apparently as part of its budgetary process, 
has reviewed existing programs. A screening process was established 
whereby certain problem programs were identified and were then subject 
to a more detailed evaluation. 

The Screening Process 

A. Programs within departments and colleges have been identified through 
the Chancellors Council. For each program the department will prepare 
the following to be transmitted to APC through the Deans. 

1. Brief statement of goals and priorities for the next two or 
three years, both as a specific program and as part of a broader 
university community. Please identify those programs which 
must be preserved or improved as well as those which can be 
considered for discontinuance. Be as specific and concise 

as passible so that the objectives can be guidelines for program 
development. 

2. Preparation of one paragraph statement on how program meets the 
essential functions of the university. 

3. Brief statement of external indications of program quality, 
e.g., accrediting, departmental awards, achievement of graduates, 
grants, statements of support. 

« 

4. Statement of factors which may influence future departmental 
enrollment patterns in the program. 

5. Estimate of portion of total departmental budget involved 
in the program. 



4^ 



Nebraska (cont • ) 



B. The Office of Institutional Research will S(MKi ihc following daln 
to departments to be routed to APC through the Deans as a part 
of the report. Departments should feel free to connnunt on this 
data and interpret it in the most useful way, 

1, lilstimaLes of degree costs, credit hour costs or other cost lactors, 

2, Course enrollment data indicating numbers nnd sources of sttuhmts, 

3, iiistiniated enrollments. 

€• These questions concern the entire department and need be answered 
only once ;ind not for each program, 

1. What competencies exist within your faculty which could or 
should be utilized to extend ecUicational opportunities to 
people of the State? Wliat resources (such as releasGd time 
for further study or special equipment) are needed to develop 
these opportunities into functioning programs? 

2, What competencies exist in the faculty to improve research 
related to the Essential Functions of the University? 

3. What competencies exist to enhance service to the State? 

4, Are you aware of educational needs of the citizens of the 
State which are not now being met? How could the University 
meet them? 



D. APC will review and assemble all preliminary data and forward it 
to the Chancellor and Vice Chancellors. 

E. The Chancellor, in consultation with APC, will determine the programs 
for which the detailed analysis is to he done. Departments will be 
notified through the Deans, 

Procedure for Detailed Lilvaluation of Selected Prot^rams 

This procedure will be applied to those i)rograms selected by the Chancellor 
for a more detailed evaluation. The evaluation follows the guidelines 
approved in the Resource and Allocation Report approved by the Faculty 
Senate and the Academic Management Model agreed to with the Legislative 
Appropriations Committee. 

Important: Not all items will apply to every unit. If a question does not 
apply, please so indicate. There is no intent in this procedure to limit 
flexibility. Wliile some of the questions obviourjy refer to instruction 
most of the procedure applies at least equally to the research and service 
functions of the University. Departments should feel perfectly free to 
go beyond what we suggest as minimal and to structure the data in ways which 
seem most useful to them. But in order to analyse departmental responses, 
some basic commonality of Inlomiation and format needs to be generated. 

In the case of proposed new programs, as much of the projected data as can 
reasonably be supplied should be made available and procedtrcb similar to 
^ those outlined herein should be followed. 
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Much of the information requested is available through n variety of 
university offices: Instituti onnl Research, Budget Oflico» Registrar, 
etc. To the fullest extent possible, departments should use alreiidy 
existing data sources. The entire report will be sent by the department 
to tho appropriate Dean for transmission to the Chancellor through 
the Academic Planning Conrniittco, 

Kach program will complete the information listed below. The information 
will be reviewed by a committee of peers who will provide an assessment 
of overall quality, a basic component of the evaluation of the program. 
The composition of the peer committees is described at the end of the 
list of data to be submitted. 



A. Goals and Priorities 



State the goals and priorities for the next two or three years, both as 
a specific program and as part of a broader university community. 
Please identify those parts of the program which must be preserved 
and improved as well as those parts which can be considered for 
discontinuance. Be as concise and specific as possible so that the 
objectives can be guidelines for program development. 

B, Is There A Need For The Program 

1. Does the program respond to long-term societal issues (racial, 
population, ecology, resources, etc.)? How? 

2. Does the program respond to broad state or regional needs (agricultural, 
industrial, cultural, etc,)? How? 

3, To what extent docs the program supplement and strengthen other 
existing University programs? (e.g., does tho program improve the 
cultural/recreational environment of the University?) 

4, Is there adequate student interest and demand? 

a. What are the past and present enrollment patterns? Wliat are 
future projections? 

b. Could the interest and demand be met better or more effectively 
at other institutions or by restructuring existing relatod 
programs? 



c. With regard to graduate and professional programs, what has 
been the placement pattern of graduates upon graduation for 
each of the past five-ten years? 

d. If future projections are available, what are the probable 
placement patterns for graduates over the next five/ten years? 

5. To what extent does the program duplicate other ])rograms 

a. within the institution? 

b, in other institutions? 
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6, Could this program be maintained outside the University? Could 
it be inaintainecl as a cooperative venture witli a program outside 
the University? 

C* What Is The Present Cost Of The Program? 

Data will be supplied in the following categories: 

1. Budgetary data, including three-year analysis with percentages 
of change in dollars and FTi: for academic, administrative, 
graduate assistants, office, iiourly operating./,, equipment, non- 
state funds , etc • 

1. Basic non-budgetary statistics over tliree years. Including: 

a. Credit hours, contact hours, majors, etc, and percentages of change 

b. Level of credit hours, including low('r class, upper class, 
masters, Ph.D.'s, etc., and percentages of change, 

c. Otiiers, including such items as Extension hours, etc, 

3, Final analysis, including three-year figures and percentages of 
change for costs and PTE per credit hour, contact hour, major, 
graduate student, etc. 

D, Is The Program Currently Or Potentially Of High Quality? 

The department will supply data in the foUc^ ng categories: 

1* Faculty, to include: 

a. Detailed faculty profiles, including courses tauglit, advising 
service, research, experience, etc. 

b. Department profiles, including range of staff experience, 
credentials , rank, pay, etc. 

2. Instruction, to include: 

a. Curriculum, including courses eliminated, restructured, added, 
under experimentation, etc. 

b. Teaching evaluation, including evaluation by students. 

3. Students , inc lud ing : 

a. Objectives for students, including service students, majors, 
graduates, etc, 

b. Learning standards, including class size, te.icher-student 
ratios, requirements, etc. 

c. Profiles (primarily for majors and graduate students), including 
pattern of courses, grades, etc. 



Nobraiika (conf. •) 



Outside recognition, incliidini> acci-editnt ion, grants, departmental 
hours, etc. 

What indications of quality are oxhibitcd by placeincnL .ind careers 
of graduates! 

What support services are available for this program? 

Are Present Resources Adequate In The Light Of Your Stated Goals 
And Priorities? 

Is the present faculty adequate to provide this prt>i;rain? If not:, 
what additional faculty must be provided, and at what cost? Wl.dL 
are the possibilities for retraining present faculty to provide 
the needed faculty capabilities for Lliis program? 

Wliat support services in terms of library, laboratories, computer 
facilities, technicians, demonstration centers, TV and audio-visual aids, 
computer assisted instruction facilities, etc., arc needed for 
this program? 

Are physical resources such as classrooms, offices, laboratories 
adequate for the program? If not, what needs are unmet? 

Are instructional and research needs adequately met? If not, what 
is needed? 

Are there sources of outside support for the program? 

To what extent is the program constrained by other educational 
programs not under your conLral (e.g., by courses offered or not 
offered by other departments, schools, or colleges)? 

Does The Program Help Satisfy The "Purposes And Essentail Functions 
Of The University" Document Passed By The Faculty Senate On February 5? 
(Those questions originate from various parts of that document; they 
may be put in context by referring to it. If a particular question 
does not apply to the program or department being evaluated, please 
indicate so.) 

Has the department used resources and developed procedures for 
optimizing class size, for Improving the quality of instruction, 
or for improving the advising system within this program? How? 

How has the department used its resources to improve the quality 
of research? 

How has the department used resources and developed procedures to 
enhance its service to the Slate? 

Has the department investigated (and introduced, if appropriate) 
new educational practices and procedures? 

How does the department recognize teaching excellence, based on 
sound scholarship and creative achievement, as a major criterion 
for promotion, continuous appointment, and salary adjustment? 
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6. What efforts have bccni made to serve a wider clientele in this 
program through 

a, recruiting ethnic minorities and females? 

b, designing an advising system to cnciuirage these students to 
complete their educational goals? 

c, providing easy access for those who wish to re-renter the system? 

d, providing intellectual stimulation and continual up-dating 
of previous training for persons who have finishc^d the major 
portion of their education? 

7, If this is a graduate program, what steps has your department 
taken to strengthen it? 

8. In case you do not have a graduate program, are your faculty members 
provided an opportunity to participate in an interdisciplinary program? 

9, How does your program relate to the extension functions of the University? 

10, How is the program related to the natural and unique resources of 
the State? Is it concerned with agriculture and rural development 
or with allied programs? 

11* If the program is a research program, how is it related to the 
Essential Functions of the University? 

12, If the program is a professional program, describe the manner by 
and extent to which it depends on a liberal education base? Is 
this base adequate? Why? In what ways could programs in the 
areas responsible for liberal education be modified to provide a 
more suitable base for the program? 

13, If the program is vocational in nature, explain in detail its 
relationship with a liberal education and the professional programs. 

Detailed Evaluation of Selected Programs 
DEPARTMENT ^ PKOGKAM 



Please provide the information requested below with regard to the program 
in the order listed. Attach an additional sheet if necessary, but try 
to be brief and concise. Please use the attached cost analysis form to 
report the portion of the department budget involved in program. Send 
the completed form to the Dean of your College, (Tliis is Part A of 
the screening procedure,) 

1. Brief statement of goals and priorities for the next two or three 
years, both as a specific program and as part of a broader University 

community. Please identify those programs which must be preserved or 
improved as well as those which can bo considered for discontinuance 
Be as specific and concise as possible so that the objectives can be* 
guidelines for program development, 

2, Preparation of one paragraph statement on how program meets the 
essential functions of the University, 
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3. Brief statement of oxtoriial indications of program quality, «.g, , 
accrediting, departmonlal awards, achiev(»nu*n t ol graduates, grants, 

statements of support. 

4. Stcitemont vf factors wdicd riy influence future di:parf mental 
enrollment patterns in the program. 

5. Kstimate of amount (in dollars) of total departmental budget 
involved in the program. 

DEPARTMIiNT (OR im'KRDEPARTMEm'AL PROGIUM) 

Please answer the following questions in the order listed. Deparhiieius 
need supply this information only once. Please be as spec i f Ic as 
possible. Send the completed form to the Dean of your College. (This 
sheet refers to Part C of the screening procedure.) 

1. Wliat competencies exist within your faculty which could or should 
be utilized to extend educational opportunities to people of the 

State? Wlidt resources (such as released time for further study or 
speical equipment) are needed to develop these opportunities in into 
functioning programs? 

2. Wliat competencies exist in the faculty to improve research related 
to the Essential Functions of the University? 

3. What competencies exist to enhance service to the State? 

4. Are you award of educational needs of the citizens of the State 
which are not now being met? How could the University meet them? 

SUGGESTIONS 

Department of Program 

Please use this form to make suggestions regarding the screening procedure. 
Specific suggestions about wording changes, additional questions, data 
supplied, etc. will be appreciated by Academic Planning Committee and 
will be used to improve this procedure in the future. 
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New York 

The ttVw York State Education Department has conducted two recent 
reviews of existing program?. In 1969 tho Department began a review 
of inaster's degree programi; for tho purpose of preparing guidelines 
and making recommendations to the Regents, btore recently it has 
reviewed selected doctoral programs. 

Master Degree Review 

Intensive planning for the survey began in the summer of 1969 with 
. the development of a twenty-one page form designed to record data that 
would reflect the character of New York State's mastet's degree programs 
fsce exhibit 3 at end of New York section). Fifty-six of tho eighty- 
two institutions offering a master's degree in the state wore selected 
for the study representing a cross section of the state's institutions. 

During the academic year 1969-70, information was collected by mail on 
enrollments, admissions standards, student profiles, curricular content 
and development, grading, the credentials, experience, assignments of 
faculty members, and the adequacy of libraries and other facilities for 
graduate study. Written assessments covering such matters as academic 
advising, library services, the nature of the courses given in different 
curricula, and the quality of instruction were obtained from a sampling 
of ten per cent of the candidates at institutions with a total enroll- 
ment in master's degree programs of fewer than five hundred, and five 
per cent of the students where enrollments were five hundred or more. 

Staff members from the Division of Higher Education, the Bureau of 
Teacher Education, and the Division of Independent Study visited all 
the institutions included in tho project. Two or three persons spent 
one or two days at each, accumulating additional information, and 
gathering opinions from administrators, faculty, and students about 
the nature of the master's degrees offered, and the outcomes presumed 
to be achieved by programs leading to them. A total of 544 curricula, 
which included 55,602 courses taken, were examined in this way. 

In addition, twenty- two of the visits were made by teams responsible 
for the registration of college and university curricula. About half 
the members of each team were consultants chosen because of their 
competence in those fields selected for special attention. During the 
course of their visits, these teams scrutinized with particular care 
each institution's methods of providing for the adininistration, staffing, 
and support of undergraduate and graduate curricula in the selected 
fields. Their reports were added to the information derived from other 
sources; tlien all relevant material was reviewed by the staff of the 
Bureau of College Evaluation. 

A report on this review was prepared in 1972 entitled ^laster's Degrees 
in the State of^ New York 1969-70 . ' 

Doctoral Education Review 

In January, 1972, the Regents announced the appointment of a Rt^gents 
Commission or Doctoral Education which was given the charge to make 
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rocomncndations to the Regents for developing policy to meet pro«ont 
needs and to guide the future development of doctoral education. The 
conmission was chaired by Robin Fleming, President of tde University 
of Michigan. Other members of the commission verc Robert A. Alherty, 
dean, school of science, Massachusetts Institute of Tcchnoloj;y; Comiainc 
Breo, Vilas professor of tYench and permanent member, institute for 
Research in Humanities, University of Wisconsin; Tliomas F. Jones, Jr., 
president, University of South Carolina; Edward M. Kresky, vice president, 
Wertheim and Company; John P. Miller, professor of economics and director. 
Institution for Social and Policy Studies, Yale University; and Frederick 
P. Tliieme, president. University of Colorado. T. Kdward Hollander, 
Deputy Commissioner «)f Higher and Professional Education, New York State 
Education Department, served as executive secretary of the commission, 
and Vernon Ozarow, director. Office of Science and Technolooy, New York 
State Education Department, served as sf:aff director for the study. 

Tlie commission had five formal meetings during the year, complemented 
by individual conferences. At two of these meetings, in the spring 
and fall of 1972, the commission met with the chief executive officers 
and other representatives of the State's doctoral granting institutions 
to discuss the progress of the study with them and to solicit their 
observations. In addition, the Regents Advisory Council for Graduate 
Education, consisting of many of the graduate deans of the State's 
universities, was kept informed of the study's progress and their 
observations, too, were sought. 

The recommendations of the commission in its final report to the Regents 
included the following: 



All iiirnsLsiii;; hoih of iitfniiiiation iiidicatiH tlint holli 
lii;-h f|ii.iii(\ nn«l <■« itnomii'v <if -^rjlr nif* ^'iirtallv f«i!iii«l 
ill in^liliiti«>itH \\hifh liau- .1 iiMjur MitiiihihiH'iit to fl<>( . 
toi.il vi\wii\'utti .Hid uliiili li.i\r ^tilistaiitial pto'/t «iiti< in 
lel.ilrd |ii'|*U. *rii|. .hli.ini:i;.T of niuhial Htip|i(trt i,f 
Iat«(l |Mo<!i.inix uhciriii tlini |ili\^i<al .iimI fin.iiH'Kil rr- 
MiiitrfH. aiiJ llir i7itci(*^t<». know lrfl;:<*. ami rtiitt|M t«*n« i'^S 
of fartilti ami Miiditils at«- nliajril i<; |ir>t ir:i|i/C(i |>y 
roii« i iitr.it in.:: thi M' pur taui^ at a i<*hitiM l\ iitiiitt d fiiiiil- 
hti of I'liMiuitiofiH. \t ilir ^iiuw tiim*. in a ^\Mv as lariat* 
and (li\i*iM' a^ i\i u York, ftnr rotiHiflnation iiiii^t aK<i 
he *fi\\'n\ Uf rr^iioiial iifi-ds. 

(3) 7/n* H<'iirtit^ sitoitltl rstahli^it .sprfiitt t oiHiitith'*'$ to 
mint ttir qiuihty of ami n*'r:l Jot ilortornl fooi^fatu^ in 
selntnl disriphimry areas. Only prof^^tittns inn^tiifii 
stauthtnh of prvsrnt m pofvnttal htfili tfualit)\ ami tieed 
ihouhl hi* ol)t*rvtl. 

This reroinninidatioii .strr^-srs tlir paiiuntMitit impor* 
t^nvr of quality and iwM in dot tnral <Niuration. Only 
programs mertiit}? Man«lar«lH «»f high cftmiit> jnd uord 
^littiilil \tf >.it^tiiin( il K\rn ihoM' pro»^riini% \sh'nU hereto* 
ftHr li.iir r«i ii K ^Midrit as |n'in;5 of HiifTirirnt qiialitv ro- 
qiiiir '^nioiis. ii iii u at this tiiiir of litititcil r«Mtiin4^'H and 
ni H «»wiiittat4>s mI ii('«-il. ili»urwi dillh iiU and rhatlMi^Mii^' 
a task this tiininciiilation ptcM'nts. thr prohhin^ it ad- 
dirsst's niii^t n#*\i itliH«N4 Uv fared. 



HernmniriHhitlona 

ill Thv Hvtirnfi shotthi n-finul all thr tint tnraf pro- 
ftntnii at hoth fhr ptihJh ami pin ah- tnstttufn^ns tts mi/i. 
stitnhnti h'tiithn an ivhtt*'lat*d \\strin for tlo*tntol rtlw 
ratnar 

'IIh* i*oni»iiv-i*»n loiisid. I- thi. irioiiiiiiniilali.ai to hr 
funilaiHMiI.il h.Ktoial « ati.ai Ian-- m ahiindaih r of 
'^onipN x }iioi,i«-nN at ihi^ iiiiir and it- )iiii|M..«-l<ii motdi. 
iwtioti at (Ik- Nal»- \ru\ i. rx.rniial if \. Y.,ik i^ io 
prt'M'ivr .iimI ^tM-ii-thni it- )io-ili(,n in tlii. \ ital an a of 
hi^rhcr ciIik at ion. 

llio Ih -rniH. a-^ r<*-|Hin-il.lf a^'*»iii \ at iIh Malr 
l foi Mmnlinaliii- th.- plannin- of hi^'lii-t ((liiiaiioii. 
shoiiM take .te|K |o iiis„,|. t|,;,t .||| Stair's dot toial 
pfii^Min-. inili\iduall\ and rolli-*tiwl\. an- of tlir lii;!h- 
fit «fiiality, that tlii\ aio pui>u<-d uitli eronoiny and 
ffliMi-iny, an«l that viOoe(onoini< and mltitial hanieis 
to aiM.«;s are eliminated. The other reeoinnieiidalion< of 
the ronmii«sion are directed *'*>eniially toward tin- leali- 
zation of thcve ;roal«. 

(2) The Kofirnts should hfm* a ^nivral paliry 0/ roti- 
cenirating prufirams at rrlaun ly hmitnl niimher of in- 
stiiuitons in the intmst of hoth highest quality ami the 
most efficient and economind use of limits I nwonrees. 
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Tlu» («»itiinissioit reioiiiiiuiuK. fint, Hial llie Hru»*nl< 
apfioint ovjliiatimi rtmiiniUi*<" in the (lisripliiKii \ nicas 
thrv ui^li li» ^tiliU Jtitl ili.ip'f (lie'iii w ith cv .ilii.iliii'! tin- 
}ir<)f:i.uii^ at riMilii)!* U» ^p«M .tinl anil i-ihiirs. 

I'hi* < I'lntiii^^ioii l>«li(*\r^ lii.tt i \ iliialioiis air o:<iitianiv 
I r^t uuulv |i\ ••M«iip» t oiti|Mi^ci| (kiiinaiilv of prrr^ in tli<* 
(Mm ijtliii.ii \ ai<M. I hi'^r pens sliodld hv |inrii:iiilv fiotii 
(Mii-ot *«t.it«\ irpit'M'itt hoili tlu' .It a<lt'nii(* atid iioiiiKii* 
(itMiiii M-rhM^. .Hill irirhidf ic(fiit lioctoial .itliiatrs. 

riu* I iMii)iiitli'('*« •^liniild nnplov coinliiiiatioio (»f tihjrc- 
live anil |U(l:!iiirrit.il fiitriia in tii.ikin^ tlitii *>v:iliialton9. 
I lu* liitiMi.i sluMilil rcllcrt the juinl icfiniirnicnls i»f !ii;;h 
qiKilit) and nrcil Anintiu llit* ^pf ijit faitoi^ that niu^t 
hr (on^idrn'd an- ijualilv of >«tiid('nt-. xhol.irlv luhimr* 
inrnt of f.Mnllv« avaiKdnlitv i>l lahoiattiiv ami hhraiy fa- 
rililii"*. MWTr-> in firadnalin;! enrolled ^tud(-ii(>. (inaiicial 
su|)pi»u« the ^npci vision .intl ;'iiidanf e f»f ^tndeiit^. and 
tile nerd f(»r eai li pru^T.ini and its appropri.itenc^^ fur 
students* career a^piiation>. 

Within the eontexl />( iliis iepi»rt, *'ni'ed for pinjrrams" 
iia** Nrvrral rfninotation^. ft in('ln(h*> the need to snstain 
the rxpan^^ion and tran^nii^'^ioii t»f knovvled^'e in even the 
nJo>l e-nteiir iiehU; lh«' ne»il to pHnhne skillfd man- 
|iouei f»)r eniplouiient in inthi^lry. eiiueatlon. jrovern- 
nienl. or othei ^e(tor^: llie nerd to develop understand^ 
tng und melhf*do|o;:ies that may he n^'d to dral with 
<io('i4*ta| prohleni^: and thi* need for new foims and l>pe^ 
of programs in doctoral eduralion. The evaluative prore- 
dure -hoiihi pive wei.udit to tlie^e several n^peet^ of need 
arrordin** to the special cliaiacter of eaeli disi ipline. As- 
segments of need shouhl he m.nle on re«;ionaK ^tatevvitle, 
and national ha^es, a;;ain an ordin;r to the >pei iai eliar- 
aeter of eaeli discipline. 

(consideration of the '\ipprf>priatene» of proL'rams for 
students' eareei aspirations" has -eneiallv not lieen em. 
phasi7ed enou<:ii in the evaluation of doett>ral pio;;rams. 
The priKliie in most fields has hem piimarilv to piepare 
}<rhoiar< for re.siMic h oriented raieers in universities. 'Hie 
>harp (*(»ntra( tion of the ai adenoe maikel ami eonse- 
quenl ;:reater likelihood of empluvnient in oilier ^eelors 
and in new kinds of woik aelivjty neetjssitate nimh 
Hoser examination of the piir])oses and pn)(es.se> of doc- 
toral education. 

Hie comniis««ion recommends, serotul^ tliat on the 
ba^is of ihe eonunilli'eV reports and recomnifndations. 

the Re^'ent** slionhl jrive eonsid^'iatioo to which f»(0- 
^lanis slionhl Ur sustained, plaied on piohation. or in 
case of serio»> deliciemv. tlcn ;:i«.t«Tcd. Proluition of a 
prop am should he foi a period of :\ yr.n-, m ihr „f 
which time it> status .shoidd he reviewe.l. I hr ipn-tion <»f 
Hithdrawal of w-i^iciiicn pi/'^ent-- dilhcnit and painful 
problem*; for all coiue/ned. When :i pio-ram that faiU 
to meii wi.mdards h.,. |„.rn iderilifietl. ihe fommissmn 
recommends that the l^-cnts. in cons„||.,iio„ 
instiliitioii affcMcd. arran^ie for it.s phasing; otit ovei a 
Q isonahlf pciiod of time with due con«.ideratioii foi the 
ERJC "'<y siudeiits involved. 

MffliffilffilffTllliiU 



New York (cont. ) 

*lhe paitj< niai Malewiile eialualions rei onnm*mh*d 
In ie aie «»ui«ia-ed as p.iit i.f the lUiient spi-, ,,,f ,.. 

Mullnn and iccvahiati f doiloia! 'diPalmo ,i, the 

^late. Ihe rniornis.ion i ii i,.. m/rs. «»f i om ^i- tli.it the 
tiLidar icMiw ..f pi-,..|.im- ro foaiol tm aandards In .dl 
aie.i. .if dodor.f! stndv jht 'ontiiuiin;' l.i^k id tin- 
Male I'lfhnalion I >ep.i, inn n! I he i .,nuiii-i/,n leiom- 
nH-mK that the Depaitmml lake ihr >,iinc a. lior.s pio- 
posrd heie with i.-ard t'l snpporl a/id ieMi^i,a|i„„ 
doctoral pro-ram> on the hasjs of tJieir leview and av 
ses</nent. 

I I ► A/'/c Ynd Stah» yfinnU h-rtti its Jlnaitt inl snpporf in 
hoth tlw pnhhr mui pinntr srrfors ^uf/i to j»rnt;rams 
inrrtinfi ifir stiuuinnis of . w>////.' or puui.tinl hi^h f/iml- 
ity. ami nmf. rut'^nmis n ithunt titrsv ffimlifirntiim^ 
.sintnhf lint hr ^upjtortril, 

Ihe cnunmssion hcliev.^ it essenliul that linancial 
•*»|»port t»f pio;!rani.s |.v the State l„. pi^vidrd sHrMivelv 
l>asi. of cpialitv ami need. A| ., tin,e when re. 
sonr.cs ji,. cmistiained aod when revirvv and leevalua- 
lion are watthwoids in dm toral edncatit.n. the Male 
should n.it expend lotmrces o/i pio^'ianis whi. h do not 
meet standards <,f l,i-h ipialilv. and neetl. Tln-s.. f„nds 
vvouhl he much moir effective if leaUoeated lo the .up. 
port of tho.se pio«;iam> that <lo meet such st.mdaids. 

The private iiisiituli(»ns' main .source of State fuiuN i« 
Bmidv aid. I'rcsrnt practice call. f(,r aw aids to he made 
for doctoral de-rees -ranted ftom all re-isten-d pro> 
jrrams The comniission recommends that awards be 
made onlv for de^ie.-s -ranted fr.>m individual pr«»:.raim 
that meet the Mamlai^U determined h) the Re-ents. Pro. 
Jiranis on prohation Wioihl also warrant support' 

Ihe eominission al.s., leiomme/uk that hnaiicial sin>. 
port for doc|or:d edin alion in the p.;!dic iiistitiilioi.s he 
piveii o/dv on a >e|ec|iM. ha^s to approved proi^raiiiv In 
addition, the present fi,iidin|: formula for doctoral educa- 
tion HI public institutions, which rcMs on enrollment. 
-h(,uM he modified to incorporate a factor hfls^d Ufxo, 
awarded de-ree. It is ui;:ed that the I.-^riHlaMre .,„d 
^oveMH.r antln.ii/e fnmls foi support of only tln.M. pto. 
;:iams meclin;. the ^t.mdaid> of hi-h qualitv. aod need. 

l .H Vr„ }urL Stfttr slioiiU strvnvjhvM its siipprnt nf all 
tuo'^inms that ntrrt tlw stmulanh of hirji ipmlity nnd 

III I'll. 

Illis lri-.,i„;,„.nil.,|li,I. i- ;iiU.,Iiiii| i', I ,To;..;,ili„n of 
llw .i.nl f,., Mm M.ilr |.. ,„.,k,. .,„ „n,,.,.,|il..il .•..iiimit. 
/M-iiI t., ,ii|,,M.rl iN ,,„.,|i|, .,,,,1 ,,,,,|..,| j„„,.,a,„, j„ 

''"""••''•'l'""-M ,,.,.;.,.„.,- „,.• (.. .,..1 i., I.oll, ,he 

•"••I pnv ,lr i„ l,|„|i.„„ M.,„^ „| ,|„.„. i„.„„,,i,„„ 

•"*■ i»l.-.M. „,,| „s,-.,„|, .,.„,,.r. .Innviiig 

""I '"-".V «" N.-U V..,k. .Ml,.,,,..,,;: ii- ....„„n,ir 

<l-*-l..|"".-.,l. .,,,.1 ,„.,ki„.- .iv.„|.,|,!, ,|,..„ ,„.„„ „,,.,„„.,., 

.'ii.l i.,lc„iM r.„ iisr |,v iiu|u>i,> ,„„| n„ven,ni.-i,l 
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pulilii iMviitutMiis iiiniinu .lanil.inls of .jiialitv .uul 
riivtl Iv vu|ijM.rhJ. \]u^ M-lr.dvr UiwUw^ wf 

♦mlv su, h |.i..;i.uiN .1. as ..ilJrc! inr in rii oininrn. 

iI.iHhII (|.. vw,uM .lilou f..| ill.' (ulMi'lltr.t.lnii /f ,4. 
'^oiii.f^. 1.1 ihiiraM. tli.-ir H.ppoit. I' i. .|ron-K in mi,|. 
mi'il.l.Ml tiM- St.iU' Mu\ \r\y Ynik ( ilv m.ike; a 

M.rnniiliiii-nl iti.un- dial tin* pm^iMin. in tlii ii in^titJi. 
tiun- llj..t ni.it .t.iml.tnU oi «ju.ilil) .md mrd th.il 
Uwr l»M-n J-\,|.,jMM| an. Mrstainnl uitli .n1r»|ii.ilc Mjp. 
!»'>«l ll Uf-r.} l!,.,t thr I.r.:i.l.iluir aiitl CuMiUui ail- 

I'lo-.i.m^ if <]n.ilirv .tnd .|„,i,!r| aUn he ^.p. 

[H.Mr.l .,1 \mi ^.nk'- |Mi\.itt> iriMilntion. T|m-. 

■■iii'l w.nhMih- t.» (!.. so ni dir fi>i r..hl,. fnliiir. Itr 
viru ..f tfiiir itn|M,iI.inM- lo dnctor tl rtl u M\rU in 
\*'lL ihr ( .)tYirni-si,„r iM lir-vr. ?|,.,! tin- li- el uf |iiin<i\ 
aid Mfiild lit- dunhUl fiorri tlh pM'-i fif |r\rl i:»2. U)0 jM-r 
dt-Lii.. 01 .i|.pn.\nn.ifil\ - M'O |,,., vr.n |>or KD: mii- . 
drntp Willi.. (It f.u-iii- -.fi-Hi. .|ur.|iori> <.f it- In-inii dis. 
Iti"|H,iiionaIr I., thr .Si.itc s and . ilv's MdArnlioii of doc: 
tor.d |.iu;/r,im^ in ]nd)li( nni^(•rMli^^. fhr av%'ard of 
MtmtK- rii.i .,nU tu /pi.didrd ptdL'ianw .is f.ir in 

ri-ronun. ndalion i I; u.nild alinu foi tlir ronrrntialicn 
t)| rr-«nirif^ in lin-ii ^u|>|)oit. 

(61 7///' Hrf!*>nts should yjoni^or itnrra^fti cnopt^nittn,, 
fuul roonlliwtinn /// dtxtonil nf unit ion hy tho institu- 
tions nithni t/tr S/atr. 

In nidfr \i, lU'^i'^ii and pinniotr piirpM-fui intrrinMi- 
tiitional r..opn.ili..n in a- nianv jiovvil,fe. th<* 

M.mMii^M..n rrtoninirnds tl,.u thr Hr;M'n!w dii^Nt thr 
Uldi^hnur.t of ninnnillrrs id MprrMiit.ilivr- in the vai- 
i«.u^ di.Mijdinatv .iif.v fmni tht* Siatr'n .locioial inwitu- 
linns. ronrinisvinn b«»lievrs thai ra.h ((.nnnittre 

Jiouhl br *ri\tn a -|)t'rilic ihiuun- ami hr infiiiicd to -nl»- 
init a rrporl of it. rlForls. 'I hi. .v^rni of rominiliti- 
fhoufd p/ovidr oppoitnnities f.,, hmh pn1>li( and piivai.- 
uiatiluliin.s lo arhirvr iniptovnl ipi.ililv. tfonnnu. ami 
Miidrn! ()ppi»rtnnil\ Ilii.s M»op(Mation ni.i\ pi o<(-rd ..n a 
varirtv of UwU: luMwrcn indi.jdn.d in«»tiliili/.nv ii'uion- 
all). *ii,«tr\\id€\ and inl/-i>Idtf. as the Ixsi ..ppn, tniiiiir- 
niav iippCih 

1 7) The Rt't^rnts IwuM insnrr tfwt dorfouii rdttnidon 
at fill iiLUitutinns nithin (ln> Stn/r hr mrrssiUr to all 
qualifml iVV/r )ork students. Enwomlr tnid riiUhml har- 
riers to (hv rndizatton oj this i;oal shnuhl br rlinntiafcd. 

Tln^ inoninicnrlatioii has a numhci /d fa. i ts. |,n( its 
Whrniv i.s that acuss to <h)(toral dinaiion muM I,r 
rqiiallv availaldr lo all ipndih^'d r,ludrnl^ at all dit in^li- 
tutions. holh pnhlir and private, uithin the Mat,-, jhi. 
conmiksion re-/ oiiiniendt* llmt the Ur-rnl^ inMiM- liial 
^•onoiiuc ami rultiiral harrirrs do ttnl pievcnl the icali- 



In fnithnanrr <,f ihi. ohjr.tivr the rommi^Hnn rr. om- 
inrnd^ that dilFrn iMrs m tnition helwren the puhlii and 
private in.liliithOi. he M,nsideie.l (n pirvml dii- o- 
noniie fadoi froio liniitin- Mndenis' ,an.,. „f opp.„tuni- 
tie^ for dortoial nhiialion. TIn' financial -lanls to 
provhhd N. v> York Mndents in sueh a n. w pio.Mani to 
achieve lhi> ohjective should he baM-d (,n med. J,, d^^vis- 
iim formulae for ihi^ puipo.e. hov%evt.r. th.s,- .-rants 
should not. v>hen mupled with niiiid> aid to the p.ivate 
institutions, rxcrod the liniit> e^taldishrd hv " ihr puhlie 
rest Mjhvenlion f.M doctoial edueation al the ]>uhhr insti- 

tlllinti^. 

In addition. tli<> Miniini-si.,n f ecoinnicn.l. 'li.,! .|.x ,,nd 
minorit) -mnp nirnd»eiship !„■ eliniinatrd a^ haiiirr. tn 
enndhnen^ In doetoial pro^iani> foi .pialihed stmh nts. 
'Ihr He-.i ni-ed to eontinue theii idruH. to insuie^ 

that uonien a. '.. r^ heietofore evluded In tho^r hai- 
riers have full nppoMnnitv to sreuir duelord education 
SO (hat the> niav Mihsrcpjontlv pailieipate n.o.e vxidelv in 
society in all thoso aetivities MMpjinr,^ mkIi piepa.ation. 

in) The Ki'f^i'nts should liujtnre that, as fuiif 0/ the 
2974 Statruidr Master Plan Pio^rvss Repnit, all the doe- 
toral^rantmf^ mstiftUions be acquired to levivw their 
doctond programs from the point of i ine of detrnnmin^ 
anew their purpose, pfare, and nerd in oveudl inMUu- 
tionul plans. 

This reeonirneudalion is made" to emphasize the re- 
sponsihility and opportunity institutions ha\e. paitieu- 
larlv at this lime and in eonjunetion with thi. .sperifie 
Htud>, to review their phius with resp^-t to doetoial pro- 
grams. Hie rrvien .hoiild include cunsidcrathui of the 
n>anv fntois that Iiaxi hrru diM iis^i-d ni thi> irport. 
-n.h as Ihr ,p,al,h o) anri n.vd for doetojal proprain^ 
hot should ak, »onMdr, tl„. irlatixr ,nip.Miar..r of the J 
'dhiinv. I" Ihr inMitulfons- o^rtall pM.H,aniv 
HMrnni-iioi is paili. ularU sin^itivr t.. thr nrrd for 
inMiliJliofM In reron.i<|rt ihr I,enrhl^ of .dh.ialioii of ir. 
-uiiii- to do, ImmI prn-ra ns a. (.aiipaird v\ith oth'*r 
ne rds on the ra/upiis. 

ll niav hr said that s^ h irvirvvs a.r p.„ | of thr re;.Mi- 
lai oni^oh,: huMfies. of an in^liliitior, and iuderfl it' is 
<'Vpr.|rd d,.it this is .0. fhr P ason fo, en.phasi/in;. it ot 
llns lun.lUM- Is that unhin tlo- . nnl.M cd the UNon.m.Mi- 
dations pinposrd in this ,rp,a! a ^.-ni lir.nii aln»o .ph-re 
foi rhai,;r ,s .^n.rialrd. '| hr oppoit„nilv fn, r|h..ii„;r 
>n<h rhan-r. u|,rir uaiianlrd. shouhl nn( hr h»M 

Thr ( omintsswuvr oj ^duration should rod the 
mnrafonnn, on nm do^o^d protirams n/ou nod) 10 
implewent rntrrui and proiedures that will imurr that 
"'/K iim ptofrrarn, fully niert ri{iotou.> standards aj po. 
frntud quality, and ured. 
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Ncw York (conL,) 



'I'hf rotntni>Nii)ii tf*riinitnfn<U an i'iu\ to ihv tn<M«ilo- 
tiuni iiti(l<*i the ftftniiliuit >tahM|. '\l\v\ inotiiinr^iid that 
pi(MV(iui«'> \h' r>tal)iishr(l that ai<' api^rnpt inir to a{i|>f\ 
uilrria f«»i iiru pu»f.Main>: H) Th»' pi M«iiai:i nui^lhivr 
»l (h'iitiili'. ^tiiMi;: < MittnnihH-iil ft>i sHjipori fintii ii> insti- 
tution: (2i the pM»[>ONC(l pio*^iain >hotil(l (l(>hnito 
prDtniM' <i( aN hi/li (»i hr lwi i|uali}v than rxi^litifi pio* 
j:iainN in ihf ^aiiu* fu'l'l. i ihr iin-il foi thr pio^i<)in 
inu^t l>r ihaih (h'iiioii-.|i.ttri! : and i h thi* iinpa< t of t)ir 
nmv prn^iatii on cxishn^ pio^iuiiiiN in ihf ^aitH' firhi 
Nhoiihl hf anaK/f'il that n\rtal! stalrwiiU' .strt'n^tliN aic 
prrM'r\t'«!. 



These recommendations have prompted reviews of all doctoral departments 
in eighteen major subject areas including chemistry, history, english, 
physics and astronomy. The reviews have been carried out through a 
process of on-site reviews by out-of-state experts. The reports by the 
out-of-state experts have been evaluated by another outside committee 
as well as by the Council of Graduate Deans. Both groups have sub- 
sequently made recommendations to the commissioner. The commissioner's 
recommendations have not been made public as of this date. 

A key aspect of the New York doctoral reviews has been the use of con- 
sultants. The following are the guidelines for consultants in preparing 
their evaluation reports. 
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Nc'W York (cont. ) 



GUIDELINES FOR CONSULTANTS' EVALUATION REPORTS 

As you know, a numbor of independent teams of consultants are 
■aklng site visits to evaluate doctoral programs in the State. In order 
that subsequent comparisons may be made by the rating commi u.'cs on aj^ 
common a basis as possible, the str-icture and guidelines listed below are 
provided for the evaluation reports. The questions posed in each general 
subject area are not Intended to constrain any further coverage or 
discussion you wish to include. 

In reviewing and rating the programs in each discipline, the 
rating committee is presented with the material submitted by oach department 
In response to the questionnaire, the consultants' report, and the institution's 
response to the consultants' report. While other material (national ratings, 
previous studies, etc.) may be available to the committee and may be Included 
in their deliberations, generally the single most important "non-partisan- 
document is the chairman's report submitted by the visiting consultant team. 
Since, in many cases, this paper will be thf- major basis for the program 
rating, it is absolutely crucial that it contain as much documentation and 
specific evidence as possible, and that it b^- written in as dry and "objective" 
a manner as possible. It is also very important that any personnel recom- 
mendations, recommendations about future directions, administrative and 
financial matters be made in a covering (confidential) letter rather than 
in the body of the report. This letter will be sent to the president of 
the Institution, but will not be an official part of the report or available 
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to tho dt*p«rtmi*nt * It uill br /ivaMrtlih- t(» t lu- iiit-luj; « omnii 1 1 »!o . (Since 
Mk' Ti'siilL of -tlu* r v'm ] i;.. I ' *Mi turn out to bi- pi a <*«miu*ij ' In category l or 

Tovlsional 1 V nnspt'iH' anti uii«o» r pt ab lo , 1 1 {.p^M-i i • «• 1 y ) ii fldvisabU' 
to avoid words of puilbr, uhicli ai o f.uro to b(» pointed t>uL an juatif icatlon 
for plaremt»nt In ontc^orv 1, n^'coj^t able • ) 

Thf^ rt»port should bf a Joju i ipt ion of tho I».Vi »^xi atin K 
slu'p^lhs .ind •.•taknr«;ni»s df tbi* proijuun. It sbcuild ii'»t cor»t/i n a pro^»raM 
rating, but should ntlrct t ii.- hi|».h standards against ubich iht drparUm-nt 
vill ivfulnally b*-: m'-aburfd. nnl\- pr(\f;iaius of hl^b qualiLy or potential 
high quality which turM iW- n.rds o» si>olely and oi ihf discipline will bo 
maintained . 

Poj ntfl Lo be Govt rt*d in the Re port 

I . Program 

(1) Does this program It ad to a broad, wz-U lnti»grated knowledge of 
the discipline? 

(2) Is it refilisLlf Jn ri-nns of faculty, f aci I i tlt^s , financial pupporL, 
Institutional coinmi nnont , students and the entploynu'nt market? 

II. P rogram Struct ure 

(1) Arc the requl rements (courses, language, dl 6s«»rtaLion ) appropriate 
lor a high qaallty proj^ram? Ait tb**> suitflbl.' to the program? 

(2) Are the career goah; (,f the stud'-nts sufficliTLiy taken into account? 

(3) Is there appropriate advis^'nunt and Counseling with respect to 
future employment? 

(4) Is the breadth of coverage w^n provided for by the faculty and 
other resources avaxlahJe? is tjujr sulflci(n't support for this 
program by. other related ones at l)u- Inst i t nt i on? 

(5) What has been the evaluation oi the proK,rajn over recent years? Has 
it been extensive and critical enough to effoct thi necessary 
maintenance of standards or linprov(>ment? 
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Now York (cont.) 



Ill • Fro|tram Financial Support 

(1) l8 the amount of financial support available sufflcl<^nt to provide 
for the sustenance of the program at high qualiLy? 

(2) How does the amount and kind of support reflect upon oLhers* 
perception of Its quality? 

IV, Faculty 

(It is particularly Important that the detailed basis for your judgment 
of faculty quality in each area or subdlsclpllnc be included here • > 

(1) What is the caliber of research and publication? How Important 
to the field is the work being done? 

(2) Is the faculty generally recognized nationally, by appointment to 
national honorary bodios, committee work, editorial service or by 
other recognition? 

(3) Is the faculty's knowledge and understanding of tholr areas 
thorough, up-to-date and broad? Are they enthusiastically involved 
in their work? Do they project their enthusiasm? 

(4) What is the caliber of the teaching? Is excellence in teaching a 
major consideration in decisions on salary, promotion and tenure? 

(5) What is the caliber of advisement? 

(6) How do the students rate the faculty as teachers, advisors and 
research leaders? 

V* Students 

(1) Is there an adequate supply of qualified students? Are the admission 
criteria stiff enough to ke^p out all but the most able? Is there 
enough financial support to attract the best students in competition 
with other Institutions? 

(2) If the institution has a special Interest in developing the 
academically disadvantaged through provisional admi£,sion6 or other 
methods, are the ultimate standards for performance of such students 
equal to the normal standards? How soon are unsuccessful students 
weeded out? 

(3) Is the rate of progress of students to their degrees satisfactory? 
If not, why not? Is the rate of attrition too great? If so, what 
is its cause? 

(4) Do the students Interact and stimulate each other? 
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(5) Are adequate advisement and guldanco iival table for students vith 
regard lo oiuplovment poaslbdf ties and opportiinf t les? If not, how 
Is ft lacking;? Are students piovlded wfth enou^^Ji and supervised 
teac!\ln^ experience? Do their teaclifng assignments contribute 
eftectlveiv toward their mastery ol the field? 

(b) Does the record of employment placement of graduates correspond to 
the Institutional obiectlves and type of piogram? If not, what are 
the differences? 

(7) What Is the level of performance required on courses, qualifying 
and candidacy exams? What is the t^allber of df ssertnt f ons (by 
area) completed during; the past live years? 

(8) What specific attention Is being given to recruiting minority 
students? Are th^re special fundH available for such students? 
What success has there been in this effort? 

VI. Facilities a nd Ser v ices 

(1) Are the facilities and services generally adequate for the purposes 
of the program? If not, whst particular Inadequacies do you see? 
What are the limitations of the library holdings In each eub-dlsct- 
pllne In which graduate seminars are offered and In which disserta- 
tions are directed? 

(2) Are they adequate for the future plans of the department? 
VH. General Comments a n d Suggestions 

Please make any comments regarding aspects of the program not covered 
In this review which you think should be described. 

Points to be Covered I n ^o"f Ident lal Let^er_to Presi dent 
I# Program and Progr am Structure 

(1) Does the U,S, need students at this level, in these areas, at 
this time? 

(2) Is this program taking Into account the way the discipline Is 
moving? 

(3) How do the program's history and plans refiecc upon its viability 
and growth? 

IT. Program Financial Support 

(1) Is it likely that adequate financial support will continue to be 
available to the program from external sources? 

(2) Is institutional support firmly enough committed for the program 

^ to continue at high quality? 
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Now York (conL. ) 



111. Faculty 

(1) What is your evaluation of L<>nuro and recruitment practices? 

(2) Has the department been successful in its faculty recruitment and 
retention goals? 

IV. General Comments 

(1) How is this program rated by the institution as compared with 
its other programs? 

(2) What are this program's notable strong and weak points? 

Procedure for Transmittal of Chairman's Report and Confidential Lette r 
When you have arrived at consensus on the report and the letter, 
you are asked to send bo :h to us for transmittal to the institution. We will 
send the report as a draft to the Graduate Dean and ask him to comment on 
any factual errors, i.e. number of faculty, volumes in library, etc. Any 
suggested corrections will be transralttt^d to you for inclusion in the report 
if you are willing to accept them. The corrected report will then go as the 
official document to the president along with the confidential letter for 
his official response. 

We hope to have your report within 3 weeks of the site visit. The 
institution has one week to respond to factual errors and two weeks to 
respond to the final document. Please note that all transmittals go through 
our office; nothing goes directly to the institution. 
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South Carolina (Commission on Higher Education) 

The Commission on Higher Education began a review of graduate programs in 
1973. Programs were selected for review based on a simple test of "low 
average degree production*' of one doctorate or two masters degrees per 
year, on a six year average. As a result of this criteria nearly half of 
the existing graduate programs which had been in place prior to 1968 were 
thus called into question. All required reports are now in and a staff 
analysis is currently being prepared for review by a newly-established 
Standing Committee on Academic Program Development. 

It is important to note that the criteria were used only to call progr<im?; 
into question, not to recommend discontinuation on those grounds only. It 
is anticipated that a few programs of marginal utility will be voluntarily 
eliminated. 



North Dakota (State Board of Higher Education) 

Bie Board of Higher Education does not have formal procedures for reviewing 
existing programs. They do have a Board Cirriculum Committee comprised of 
two of their seven board members. The committee meets intermittently with 
representatives of the Board Office and various groups from the state coUe\ 
and universities. More often they meet with the deans. During these dis- 
cussions they also review the class sizes in the various subject areas and 
seek justification for the continued operation of small classes. 



Tennessee (Higher Education Commission) 

Tennessee does not have established procedures for the review of existing 
programs. They have reviewed programs that had low enrollments and/or 
few degree graduates. They have also reviewed programs that had much 
higher than average cost per student or per credit hour. The original 
method utilized for these reviews was to ask the institutions to indicate 
why their programs productivity was low in output or high in cost, or both; 
what they planned to do about it and to develop the report based on these 
responses which were shared with members of the legislature, the Governor 
and the general public. This procedure has resulted in a consolidation of 
a number of small programs and the elimination of a few. 
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Ncw Jersey (Department of Higher Education) 

The Department of Higher Education is now in the process of conducting an 
extensive review of 120 existing graduate programs in the six older state 
colleges oi" New Jersey. 

The purpose of the review is to secure expert judgment and information 
about the programs, so that all of them might achieve a high level of 
quality and be sustained with adequate resources. 

There are now one hundred and twenty graduate programs in six New Jersey 
State Colleges. Almost all are Aster's programs, many of them in teacher 
education, several in other professional areas, and a few in the traditional 
arts and sciences. Although no one can reasonably expect a reversion to 
the feverish growth of graduate studies that occurred ten to twenty years 
ago, it is possible that the review of State College graduate programs might 
suggest selective increases as well as some decreases in program authorizations 
course offerings, and enrollments. But until the review is substantially 
completed it will not be clear where the greatest need and the best poten- 
tiality for sustained high quality might be. 

Evaluation of programs is carried out by consultants who are recognized 
scholarly and professional authorities, knowledgeable about education in 
their fields, and capable of making constructive suggestions for improving 
programs. Consultants are chosen jointly by the Department and the Colleges 
Reconmendations of persons to serve as consultants come from professional 
and scholarly associations as well as from the Colleges and the Department. 
These nominations are then discussed and agreed upon by faculty and by 
College and Department officials. 

The procedures and the standards of judgment which govern the review are 
described in a document entitled "Developing and Strengthening Graduate 
Programs in New Jersey State Colleges". It was formulated by an Ad Hoc 
Committee of representatives from the State Colleges, chaired by Dr 
Robert Birnbaum, former Vice-Chance Uor of the Department. The document 
was approved by the Council of State Colleges and the Board of Higher 
Education. The. review is being coordinated for the Department through the 
Office for State College Programs and is monitored by the Committee on 
Graduate Programs of the Council of State Colleges. 

Criteria For Selecting Consultants 
*1. recognized authorities in their fields 

2. knowledgeable about and concerned with education in their fields 

3. likely to understand readily the role and problems qf state 
colleges 

4. likely to help faculty and other develop constructive sug- 
gestions for improving programs 

5. likely to appreciate the merits of differing opinions and 
approaches in a field 
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not related to the institution offering the program for evaluation 
and not associated with any educational institution in New Jersey 

7. not primarily associated with an institution from which a signifi- 
cant percentage of the program's faculty received their professional 
training 

8. free of any other personal, institutional or ideological obliga- 
tion that might bo supposed in the normal case to affect impartiality 
of judgment 



" Items marked with an asterisk are taken verbatim from ^'Procedures 
for Evaluation of State College Graduate Programs*', Item 2, 
paragraph b. These are criteria of eligibility, and presumably no 
exceptions would be made except in the clearest case, with general 
consent, when no suitable alternative is available. The other 
criteria raise more difficult questions of interpretation, but 
might be considered important criteria of desirability. 
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DEVELOPING AND STRENGTHENING GRADUATE 
PROGRAMS IN NEW JERSEY STATE COLLEGES 



During the <>ast five years / an intensive and sustained 
effort has successfully changed the undergraduate mission of 
the State Colleges of New Jersey from that of preparing teachers 
and other school personnel to that of multi-purpose institutions 
with a mixture of programs in the arts and sciencos, professional 
education^ allied health, and the emerging technical fields. 

An essential element in the development of these institutions 
is the strengthening of existing programs and initiation of new 
departures at the masters degree level consistent with the Master 
Plan for Higher Education in New Jersey. To assist in this 
process, the Board of Higher Education has approved a procedure 
for systematic and analytical review of all State College graduate 
programs • 

After a college has successfully completed the review 
process, the Board will permit the college to increase enrollment 
in approved programs, will increase faculty-support levels to 
those planned for similar programs at the State University, and 
will permit the establishment of new graduate programs in those 
areas justified by need and supported by adequate resources. 

The attached materials indicate the bases for this process. 
The evaluation procedures to be followed are indicated in 
Procedures for Evaluation of State College Graduate Programs . 

Since the procedures rely heavily upon the use of 
outside consultants, a protocol for consultants has been prepared 
0 entitled Guidelines for Consultants for State College Graduate 
O Programs , The general criteria against which 
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programs will be evaluated are contained in the document 
Standards for the Development and E valuation of Graduate Procj rams 
in New Jersey Colleg es and Universities as supple- 

mented by the document The Evaluation of Graduate Programs in 
the State Colleges of New Jersey^ 

The evaluation program itself is administered by the Depart- 
ment of Higher Education in cooperation with the State Colleges 
and monitored by a standing Committee on Graduate Programs of 
the Council of State Colleges. This Committee also serves as a 
forum in which more general issues of graduate education arising 
out of the evaluation effort can be discussed. 

In addition to the materials indicated in the attached 
documents, evaluation will also consider analyses prepared by 
the colleges for each program containing data related to employ- 
ment opportunities and manpower shortages in those fields in 
which these are applicable considerations, and the number of 
qualified applicants and available spaces for each of the previous 
years in which the program has been offered. 

The ultimate objective of this review program is the 
establishment and continuation of graduate programs of high 
quality, responsive to student and public needs, and supported 
at an appropriate level which will place New Jersey in a leader- 
ship position in the provision of masters level education. 
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ACADEMIC PROGRAM CONTROL IN THE STATC UNIVfKSITY SYSTEM OF FLORIDA 

In response .to t't.> tMany inquiries about pror ednrc, fo!low<d in iniplcmf nf i rvj 
academic proqr.im control within rhc St.itf Univ. t-Jty Sy.tnn of lIorid.T, Ur. Allan 
riicKer, V •(> cmncolU.t lor ">c<i.ltmic AHairs, li.ts piop-Uf. ••< (ollowin.; < i-trtwv . 

Hi<;roricol B>ickgt otind : D«»vf lnpnu»nt of the State i vo r s i I y System 

In HOii, the Florida Li^m" s lat uro oslablishc.l throe stafp-supportPd institutions 
of higher learninf), otio ir. G.i i m-s vi 1 1 r for tnon , another in Tallahasseo fo? wo.ntn, 
ono a third in 1 a 1 1 ah,iss«.-<. tor the black population. Thrso three institution., 
which were placed jnder i h»> nr.vernance of a siicjlr lay Board of Control, have since 
become the institutions known r.speclively as thr University of Florida, fin, 
State University, and Florida A and M University. Althouqh sovei il junior Colleges 
wre established between I905 and I96O, no additional state universities were founded 
during this period. However, in the twelve-year span between I96O and 1972, six new 
state universities were opened— an average of one new university every two years. 
Along with the three oricjinal institutions, the six new universities were placed 
under a single governinq board. These nine state univer.ities comprise the Sta'e 
University Syster. of Florida. The single lay board governing all nine was statu- 
torily reorganized in igC; to become the present Florid.i Hoard of Regents, and con- 
sists of nine individuals. <Mch appointed by the Governor for a nine-year tertn 
The schedule for appointing Regents is such that each year one Regent completes his 
or her nine-year term and another is appointed as a replacement. 

The responsibilities of the Board of Regents include the determination of the 
role_ and_ scope of each of_ the nine institutions , the deveT7;F'»<'nt of" polici'er'f" 
governing their activities, the esjt^bjj^hu^ degree programs in 

^ State Un I vers! ty S;^n in such a way as to avoid imnoc^^^^aTTd^'^lT^tu^'lii^d 
the control of supporting educational functions and operations. The Board of' 
Regents is also charged with the responsibility of preparing an annual Slate Uni- 
versity System budget request for submission to the Legislature. The Leg.slature 
determines the budget which will be approved for the :.tate University System and 
makes a lump sum appropriation to the Board of Regents for this amount. The Board 
m turn, allocates budget to each of the nino universities under its jurisdiction 
The special issue of MFMO, dated November 1973, describes in general terms, guide- 
lines and procedures for generating university allocations. 

Currently, there are 28 state-supported junior and community colleges located 
hroughout the State of Florida, each under the jurisdiction of its own iLTlold 
ratner tfian al I of them under a single governing agency, such as the Board of 
Regents. The activities of the junior colleges are coordinated by a State Board 

leges four of the n.ne state universities were established as upper division in- 
stitutions I.e.. they have no freshman or sophomore classes. T^ey admi only 
iunlor college graduates or equivalents into the junior ye ir and p^ovldl the final 

t'" c'::e"o?'on':"nI"::tt': TLT* r --ter.s progra.,. .nd In 

• /> university a doctoral program in education. In 1971 an ArH/-..U 

norlHr'""':;' ^'^^ ^^-^^^ universities and the public junior co Mel! ?" 
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The Board of Regents employs a staff headed by a Chancellor, who serves as the 
chief executive officer of the State University System. He, togeth»»r with several 
vice chancellors and a staff of approximately 100, including profes'. lonal edu:.T 
tors, technical and secretarial personnel, manages the Stnte University System on a 
day-to-day basis in accordance with policies established by the Board of Regents 
and the Legislature. Responsibilities for planning and developntnt in specific 
areas, such as academic affairs, fiscal affairs, and construction, are delegated 
to appropriate vice chancellors. 

The State University System of Florida is analogous to a large multi-campus 
institution of higher learning. Each of the nine universities In the System Is 
headed by a president, who is responsible to the Chancellor and the Board of 
Regents. The presidents have their own respective complements of vice pre'^idents, 
deans, and campus administrators. In Florida, the nine campuses of the System do 
not have a common name, as Is the case in other states, such as the University of 
California System or the State University of New York System. Each state univer- 
sity in the Florida System has Its own unique name. 

Academic Program Control 

In 1969, the Board of Regents published a document entitled. Comprehensive 
Development Plan (CODE) of the State University System of Florida7l969-)98o . The 
document describes "in broad design the current operation of the State University 
System, sets forth in general terms the future goals of the System, and outlines 
the policies and procedures to be followed in attaining the stated goals." One 
such goal is to provide maximum educational opportunities for the citizens of 
FloMda, without unnecessary duplication or prol i ferat i'S^T of pT^rlli^ . sTnce" this 
implies formaTTTed academic program controT and coordination, the responsibility 
for developing necessary implementation procedures was delegated by the Chancellor 
to the Vice Chancellor for Academic Affairs. There is no need here to provide de- 
tailed justification as to why academic program control is necessary. Rather It 
IS sufficient to recognize that the extent to which academic program control is 
exercised is directly correlated with the financial resources available, student 
demand, societal needs for ind i vidual > wi th specific competencies and skills, the 
job market, and faculty aspirations. The priorities established by a single insti- 
tution within the System for the offering of specific programs may not necessarily 
coincide with the priorities of the System as a whole. Moreover, the Legislature 
takes into consideration the many and diverse needs of the entire state, and within 
the framework of available state resources, determines the allocation to be qiven 
to the State University System. Only academic program control on a systemwide 
basis can function with such a statewide perspective. 

The nine state universities In Florida are general purpose universities ;ind 
serve the citizens of the regions In which they^i?ri?cftS^N5rW^5The^^ 
universities have similar general purpose roirs which dictate <j common.ility in pro- 
gram offerings, but in addition, ench fs chorqcd with -.pecific purposer. and roles 
which in turn, imparts a chamctcri-.t ic un'quencss. Thus. r.ome universities h.ive' 
programs certain discipline^ which .,re not of for...J by thr5Th e - rs ' . As qene 'rTr 
purpose institutions serving ci t izcns in th?i>— TpTTtTVc-Ti-gTSJ^rTeach institu- 

■ on IS authorized to offer hir,l, ce^ard, low coot programs at the baccalaureate 
level in the arts and bciences. education, „nd business administration. This is 
dZl'n/ necessary duplication. If university wishes to offer high cost, low 
demand programs at the baccalaureate level in the th.ee broad discipline areas 
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ncntioned above, or b.iccalaureate progriiins in other areas, or .my master's or 
doctoral level programs in any discipline, nut hi. r i 7a t ion muM U obtained from the 
Board of Rocjcnts, C.irrontly, all of tlu' Ph.D. proqrnms av.Tli.nie in the :i.ite Uni- 
versity System except '.evtvi are offered by two universities, six are offered at a 
third institution, and one doc' -a I pro()ram at a fourth. Board of Regents approval 
i<-^ also nece':sary before a ur. ersity irviy offer curricula .ind confer degrees in 
professional programs , such as medicine, law, engineering, architecture, social 
work, etc. 

In 1969, when CODf; war. first published, program projections were made on the 
assumption that enrollments would continue to increase in future years at the same 
rate as in past years. The CODF document contains quantitative and qualitative 
criteria which universities are required to meet in order to be eligible to apply 
for permission to offer either master's or doctoral level program... These criteria 
were based on the assumption that any university able to meet the criteria had at- 
tained the critical mass necessary to offer the next highest level degree in the 
discipline. For example, to be eligible for the proposing of a master's level pro- 
gram in a given discipline, the university must have conferred an average of ten 
baccalaureates per year over the previous three years; and for a doctoral program, 
an average of five master's degrees or equivalent per year over the previous three 
years. In addition, quantitative criteria were developed regarding the number of 
faculty with specific competencies required to teach in the graduate programs being 
proposed. Qualitative criteria, always more difficult to develop, were also in- 
cluded m the requirements universities must fulfill to be eligible to apply for 
autfiorization to offer any new degree program. These criteria are described in 
detail m the CODE document. Of course, a university also needed to justify its 
proposed program in terms of societal needs, availability of jobs for graduates of 
the program, etc. However, the biggest hurdle confronting any university when pro- 
posing a new program was demonstrating the presence of the necessary critical mass 
to enable offering the proposed program with minimal added resources. 

Since 1969, when these criteria were developed, several unanticipated situa- 
tions occurred. Although enrollments in tf,e Lystem as a whole increased slightly 
enro ments in some universities remained the <-.a,ne or decreased from the previous' 
resu ina'i' ^ ^ ' V • . f^^e — - c conditions of the .tate and a ion a ed, 

resulting m ewer jobs available in industry, state agencies, and educational 
institutions for university graduates at all levels. The Legislature beaan to de- 
niand accountability for monies expended, effort of faculty and s a?f! the nuanJy 
fnouZl''' -'^P'°V-^ility of university graduate . Co'r e ond- 

<ngly the resources appropriated to the State University System by tt,e Lecislafurp 
we e less than expected. The University System and its Lm^e 1 "t e werl 

In spite of the profound changes described above, many of the younger univer- 
sities were still able to meet the critical mass requirements -.tafed In the I969 
CODE document, which made them eligible to apply for ,111 1 hor i /at i on to offer new 
graduate degree programs. Since most of the new state universities were opened 
within a twelve-year period, all seemed to meet the critical mass criteria at ap- 
proximately the same time. Consequently, in 1970 the Board of Regents received re- 
quests for authorization from the younger universities to initiate 65 new doctoral 
level programs— a proposed increase by almost 70 percent beyond the number of Ph.D. 

o 70 
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programs available in the State Univorsity System at thol tirr'e. it became evident 
that meeting thf» criteria contained in the CODE document, irscludinq the acquirir^q 
of critical mass* could no lonnor renuiin the primary jus t i I i cit ion fur b()»ird of 
Regents authori;Mt ion of new doctoral programs. Since 1069, the following steps 
were taken by the Bonrd ot Regents to pr ovide «idd i t i()n;jl *ic<ide iic program control 
in the State University System of Florida. 

' • In ^971 the B oard of Rege n ts est ribl i sh ed ci f i vf-yen r morntor i urn on the 
addition of new Ph.D. programs . Tho moratorium will pi'oh.ibTy be extended "upon the 
completion of the five-year period, except in the cases of selected disciplines. 
The morcitorium made it possible to defer decisions regardinq the approval of addi- 
tional doctoral programs until a thorough review could be conductf?d concern inq 
doctoral level education needs in the stato as a whole. 

^' <ri 1973 formal procedures were initiated for identifying s im i la r d i sc i pi i ne 
offerinc|S within the State University System . Universities in Florida and across 
the nation often have different titles from one another for similar offerings in 
the same discipline. For example, the curriculum called Criminal Justice at one 
institution fs termed Public Safet.y and Contemporary Society at another. There are 
also organizational differences in the manner in which academic offerings are pre- 
sented. For example, Mathematics Education is a degree program at one institution, 
whereas at another it is a subspecialty or track of a degree program entitled Cur- 
riculum and instruction. Because of these differences in nomenclature and organi- 
zational design, it is difficult to identify and compare offerings in the same dis- 
cipline from one university to another in terms of cost effectiveness, enrollments 
of majors, degree productivity, job availability for graduates, etc. 

Procedures have been developed for equating what are essentially similar 
programs of study in order to establish a basis for comparison and control. Uni- 
versities are requested to assign to each of their degree programs and subspecial- 
ties an appropriate code number selected from the list of code numbers in the HEGIS 
discipline nomenclature--a nomenclature and coding system designed by the U.S. Office 
of Education for the purpose of surveying similar discipline offerings at colleges 
and universities in the nation. Universities were also asked to indicate whether 
an offering was a degree program or a subspecialty or track in accordance with 
specifications provided by the Chancellor's office outlining what apr^opria tely 
could be considered a degree program and what appropriately'should be considered 
a subspecialty or track of a degree program. Although each university is permitted 
to retain its own discipline titles for programs or tracks, the State University 
System office will consider all discipline offerings in the System in terms of the 
common HEGIS discipline nomenclature code numbers and the Chancellor's definitions 
of programs and tracks. Thus, by applying the same code number to similar disci- 
pline offerings at different state universities, regardless of what the offering 
is titled or which college or department within the university administers It; and 
by applying common definitions for programs and subspecialties or tracks, regard- 
less of whether a given curriculum is considered by one university to be a program 
and by another to be a oubspecialfy or track of a bioadcr based degree program, 
the State University System office can conduct comparison studies with more pre- 
cision. Identify more easily programs which may be duplicative, and if duplication 
•s justified, can treat similar discipline offerings more equitably for funding and 
other purposes. 

7i 
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^' ^ P^^ ^^"^^ cuinptr d w h ict re quir<*s all un i vers i ti es to request and rec e i ve 
au t hor 1 7 a t i on f rom t hy Prvi r d ot R( ger. t ^ to pi fin tx^w de gr re prcxj rdms* , or si ib s pcci a) - 
tie^ wi thin exist ing autltor i/cTT (it gr (~'pro(jrams , |)rioV to 1 1~ su brnTs s ron" n f .) 
forpa) propose)) . At tiM pT^f^mnq .^nthorT/tit ion hos Tnvn obtainn, iin i ver i t ies 
may then sijl)mi t proposals tor nvu *Joqree programs no soonor thdn one, two, or three 
yearb for bachelor's, nuistor's, nr doctoral programs, rtspoc t i vely Exceptions 
to this tine frame may ho tiraoioii by the Board of Krqents it a university can di-m- 
onstrate tho existence ot an urgency which requires that a specific program be 
initicited earlier tf)an e.(njlJ t)e permitted under the policy guidelines* Speci«jl 
fcr.::s requiring varicnis Lvr^^'^ ol information must be completed by universitir* re- 
quest inn planning author! /.ilion . All pl.inninq authorization requestb must l-e re- 
ceived by the Chancellor's otti^e no later than February 1 each year. In 19/3, 
the Chancellor's office received requests for planning authorization for 52 new 
programs.. Of this number, 16 v^ere approved for planning, arid II v/ere recommended 
for planning as tracks within existing authorired degree programs.. By February I, 
'97^, this office received approximately ^5 requests from un i vet s i t it*s for 
authorization to plan new degree proqrams or subspecialties. These are currently 
being reviewed by the Ctiance 1 1 or ' s staff to determine which planning authoriza- 
tion requests will be recommended to the Board of Regents for approval.: 

A . Submi ss ton to_ £h£ Bonrd of^ Regents of a_ formal p roposal for a^ new degree 
program or a^ new subspeci aj t y or track in an exf slirwj degree program after pla~ 
" . j^^j authorization has been obtained n^ust foil ow ttie procedurcb a nd cri ter ia i n ~ 
cjuded in the 19C'9 COnE docurertt . Proposali. Muy~ be submitted onTy at specffieT 
times and must include just i < ications, availability of resources, anticipated stu- 
dent demand, manpower needs, anticipated costs, and other pertinent information. 
Although proposed programs, subspecialties, or tracks, which had received prior 
planning authorization may be denied depending on changes in manpower needs, stu- 
dent derriand, and anticipated resources which occurred in the interim, it is assumed 
that prior authorization to plan, normally would insure tavorable consideration by 
the Board of Regents. 

5. An_ annual analysis of_ degree p roductivity is conducted for all degree pro- 
grams at all levels . Every year the number of degrees awarded" in each program for 
the previous three years is reviewed. If the number of deqrees awarded during the 
three-year period under review falls below an established finnirmjm number, then the 
program is placed on probation. For example, over any three-year period under re- 
view, each doctoral program must confer 6 dpgreo*^. each master's program must confer 
9 or 15 degrees, and each bachelor's program must confer IS or 30 degrees. The 
lower figure represents the expected productivity if the program is the highest 
level degree program authorized for a university in that discipline. The higher 
ftgure represents the oxpecled productivity if the program is not the highest level 
degree program authorized for a university in that discipline. If the program re- 
mains underproductive for three consecutive evaluations, it is then subject to an 
In-depth study, the results of which will determine whether the program should be 
terminated, absorbed as a track in a broader based degree program already author- 
ized or whether the underproductive program can justifiably be continued It 
would be impossible to conduct a thorough investigation of every program every 
year. The use of degree productivity as a means of identifying proqr/ims to be eval- 
uated rests on the assumption thai wilh the exception of professioanl programs such 
as medicine and law, degree product i v/i ty is tfie best singlo index which correlates 
meaningfully with enrollments of m.ijors in the progrim, ;tudent demand, job market 
for graduates, quality of the program, etc. In ISv3, graduate programs were 
ftr oVl ""f underproductive, 16 were- pla.ed on probation, and it wa. recom^nended 
that 22 be absorbed as tracks or subspecialties of exist inr, authorized degree pro- 
grams. The 197A analysis includes a review o| t>accal.,ureare as well a', gradual.. 

Jo?irnr??ry''''- ''"^ onalysis, it is anti.ip.c.d that a 

total of 113 degree programs will be placr-i on probation. Of this number. 9 are 
ER?C^ ''^ ^^"^ master's, and 66 are baccalaureate degree programs. 
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6. Co nt inuint} educat ion and of f -campus courses aid programs have been under 
iil 9g"P^-^' supervision and control of tho Chan ce llor " s of fjcc lince~]9^ The 
State of Florida is divided into'nriu- "<j«>ogrrtph i~c req i ori"s'."Tif ureacl)" university is 
absicioed responsibility tor sfMvirx) the region in which it is located. A univer- 
sity mav offer within its region, and without prior approval from the Chancellor's 
office, any off-campus credit courses or programs which have been authorized for 
on-campus instruction. Upon request, a university may offer credit courses or pro- 
grams outside of its assigned region only if the university located in the outside 
region does not have the program authorization or the capability to respond to the 
request. Requests for universities to offer credit courses or programs outside 
of their respective assigned regions must be approved in advance by the Chancellor's 
Office. There appears to be no need to employ personnel for the pu-pose of quard- 
ing each university's territorial rights. If a university of fei s a credit course 
or program outside its own region without advance approval from the Chancellor's 
office, the university whose territory has been encroached upon usually submits a 
corriplaint very quickly to the University System Vice Chancellor for Academic Af- 
fairs. 
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Conclusion 

Tlic foregoing survey is the first step in the process of further 
developing the program review procedures utilized by Lhe Iowa Board 
of Regents. In the weeks ahead a more detailed analysis of the 
policies and procedures will be conducted, Tliis analysis will hope- 
fully lead to a series of recommendations regarding program review. 
If feasible, a model process will be developed which will take advantage 
of Lhe information gained in this survey and analysis, Tliis eclectic 
model will hopefully provide for the comprehensive review of programs 
yet provide for a degree of flexibility so as to not unduly inhibit new 
and innovative approaches toward learning. Hopefully too, this model 
will provide for sufficient input from the various institutional consli- 
tuents so as to maximize its legitimacy on campus. This -h^Llc] will Llion 
be recommended to the Iowa State Board of Regents for use in Iowa. 



1) Leonard E. Goodall. "Emerging Political Issues for State Coordinating 
Boards" Journal of Higher Education Vol. XLV, No. 3, March, 1974 

pp. 219-228. 

2) Robert 0. Berdahl. Statewide Coordination of Hifther Education 
Washington, .D.C.: American Council on Education, 1971, p. 136. 

3) Op. cit Berdahl, p. 158 

4) Glenny (et. al.) Coordinating Hifilier Education in the '70's 
Berkley, Calif.; Center for Research and Development in Higher 
Education, 1971, p. 41. 

5) Education Commission of the States. Coord ination and Chaos 
Denver, Colorado, December, 1973. Report No. 43, p^ 51. 

6) Ibid., p. 51. 

7) Ibid., p. 51-52. 



74 



o 

u 



ERIC 



a 0) 




W 0 n4 3 

V 0 :3 4J ^ 

^ E| 3 N 

•HO ^4 « u 

I (0 M l4 (3D <d 

I > C3 3 ^4 r-l 

«c 0) u o a 

CO to r*» 




• "'.L" i • ' ^''^h'f^^r/^^^. r '^^' 






0) U 0) If 



CO 



W1 



01 

> o 

> 4J « 

{:) MOO) 



•72- 



u 

a 

B 
D 

U 

o 

c 
u 

a 



0 
O 
•H 
U 

H a 

a 

6 



H Cd Q) <d 

Cd > «c ^ 

C O 4J Q) 

f«4 a o 

< cn 



o 

•H 

6 Cd J3 

O 4J 

o a 

QJ OJ o 



u 
cU 

0) 

a 

0) 
CO 



U3 







s 


o 

•H 

(0 iJ 

0 w Cd 




o 

u 
o 


Cd 6 u 




M Cd 3 






00 M 




O 00 b] 




M O 








m 




CU o 




> 
o 


u 


a* 


Cd a 4i 




0) -H c 
B Q) 


* 


1 Q) 0 


O 




J-i TJ *i 






3 Cd M 






o u Cd 






^ < o. 






Q) 


Cd 


o 


IM Q 


3 


o 
ca 


o o 


a 


Cd 


Cd 


CU 


C 3 »H 




o Cd c 




o 


»rl Q) Cd 




u > 






•H 3 rH 




> CO 




M 


•H 0) 

Q a 




a 






0) 






04 







0) Q) 

- W 

► J-i O O 

go o a . 

(d CX «4S 4^ 0) 

0)0) O 0) 

H 05 W 05 



*J O 

in ^ 

01 -H o u 

H > 4J W 



0) Cd i-i 

CD CD cd 

M 0 O > 

Q O O. O . 

P4 a o ^ 

CO M a* 

0) a 

05 



a 

i-l o 
Cd •H tt] 
CO CD Q 
O (0 Oi 

O 0 O 

04 3 

CO 



(0 

4J Cd 

o > 

0) o 

a u 

CO a 

o a 

u < 

04 



U-i o 

o u 

5^ 



a 

o 



ERIC 



0) 

6 CO o 
^ o o< 



CO 

>^ 

O 
I 

o 

so 



0) 



0 ^ • 

a o 

0) O 

1 -H *j 

u Cd u 
t3 d ^ 

2 0) (0 
i c3 

T^ 
a 
0 



T 



i 



(0 

H 
Cd 

o 

vO 



U4 ^ O 

O -H 

\ rH 4J 

*i Cd 3 

C (0 4J 

0) O •H 

/-N 0 a 4J 

a o CO 

^-^ O M C 

04 H 

0) 

> 0) 0) 

' 0) *c x: 

P 4J 4J 



■73- 



EXHIBIT 3 



Forni for lUircau Use to CoMrct Uit.i 
New York Master's Degree Study 



NAME OF iNsnrurroN; 



DATE : 



DEG. 


CURKIC. 


SriDENi'S ENKOLLED F/\Ci;LTY PIU)plLE 


'iaLi icul a t« cl 




full - lilM- 




F/r 


iv r 




IV T 






iV ith 




M ist 









































































iifX.KEh KEQUIREMENIS 
no. of cr«^»dit 
Krs. , residence 

time limits, <aln»r) 



pQcalty 



c. 



f . 



Institution's statement of qualifications for graduate 
faculty status 

1) Policies governing gr.aduate teaching 

2) Backgrounds of facul^tfy as reflected in vitae 

Educational qualifications of faculty 

Faculty experience (years of graduate teuching) 

Publications 

1) Quantity 

2) Quality ' 

3) List the' more and less active facultifs by curricula, 

Staffing of curricula, including balance of specialties 

Superior curricula: List currirula ludqrd superior on a 
state-wide basis, usmq educ.-^.t i rma] qua L l f icat ions of 
faculty, faculty experience, quantity ami qualify of pnb- 
iications, and staffing a^.-^ the criteria. 

Faculty Working Condition.':, xncltidinq salary scale- al- 
lowances in faculty workloads for tlirsis d.rocLion, ad- 
visement, and research, sabbatical and oHic-l Ic-aves- 
research funds available; and policy on distribution 
ot research funds. 
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Page 3 



Page 4 



Page 5 
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(N(»w York) 



How .ue n.'L- t .iLi f'V.^ 1 w ii : '..n?^ f ; i. < owti prwoiu i.. 



ERLC 



Admissions and r^du-dtionol incju^i.n.^ my ^nop--> 

tions of rne m:ccc:^s of t.h» vt. . ; .n , p(J;:.v r,r thr^ 
quality oh odt^cition. ' ' 



iipon.-i:-)] f frt Its ir)] ] 1 -|i 1 . : ,^ •f)'...}-t-i i .* -,^'1 * 

' 1 1 : n t . . k fiv ; i\\ < M ♦ ' ». ' 1 ♦ 

b. • or. ^.-v r , ir^. j.,..,, . ^^^^^ 
tor nc^n-'Mt i j( .iMv d • t,id. rJ . 

c. Jtudent Keloid:: -^n.pl mo - ] ' ;i U i .i: t . : -m i on:- wit. r.no h 
r^OO grodU'ite :5t -idrnts r,nd :>>: it l i o w; t I, i:,Mrf tLm ^Mi^j 

qr id'.iutG >tudrnt . , 

d. Admissionii proiiLc of entorina doss, m,, v". in iriM;- of i-^ucio 9 
undergraduate record and achievpiaent Lei.i'.. 

e. Overall Quality of Students: below avf.rrnc, .jvetaq^^ 
above averaqe, or superior, based on urri» re; uiu itf i / ^^.rd 
and tests. 

Grade dir/rribtiti* n for p.ujt 2 y» w :i P^j^,^ Iq 

Attrition, including p<2rcent wh.. t rv.inoi.tr dc^.r-en 

and principal ca'j.^?(-.s r^f.^UMi^d t-y i {.» . . t i -it M\n. ' 



i. Academic adviseri..7nt of Matricnl Mna an.'^ Nor.- , m- j . -u lator' Paao n 
Student5^ includinr, policy ind ur.ctiro. i i -Uiatc.. , age 11 

j. Students* Opiniorio Jiipled by C-K" " .nricn r e Page 12 

1) Reasons for choice of j nst itu^ i on 

2) Student participation :n pol ; r y .t:,jK: no for ir:titM- 
tion and/ or curriculum 

3 Student as.sG J5:iuent of adequ.K^y of .jidvi .sm cnt 

4 ^tudent asnessmont of adcqua-y rt lAbtciry 

\^^^J^^^-ion of programs, incluanu; : Lr..nqthL. 
and weaknesses cited 
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(Now Yi)L-k) 



fiicilities, .jnd buduot. ^ 



I'it^r 14 



the (^arr i cnii -a . 



7, 
8, 



Cnrr ic\: ) um 



Lducational q.v.iLs r-ind p]anr.;'-iq of 'Mir cub). At 
doctoral in::t » t ; r^ri:., i3 the H.K^ter'j.A docnoe i v'on-^ 
:^oj .it Lon pr J I' 

Extent to wiuoh r f--fTurc}) a :-jigni f i cant- rUtn.^jnt m 
iMaster's curricula. 

Provision tor testing of eL;;5ential scholarly tooL^.. 

Curriculum prjlicies, including availability ol under- 
graduate courses; for graduate credit, enrollment of 
undergraduates m graduate courses, dj^.tj notion be- 
tween undergraduate <md graduate work, dir.tmctLon 
between prof ej:r>iona 1 and academic qr.Hduate rumcula, 
remediation oi def j cienci or; . 

e. Innovative elements in qraduritr- proqiainn. 

Evaluation n i -:ll!:iL 'Isr^^^^P ^ 1-'^ 

FgjJ^w-jip_^^ in-lM(iir.q number cietivnly 

employed m profcsJiion, number r-nicMl^^q in d<ietoril pro-^ 
grams, contr i but i ons ' made to fi^ld:, ot cnde ivf'^>, i( avail- 
able. 



Page 17 



Page 18 
Page 10 



SUMMARY 
a 



F'age 20 



Substandard and superior pi.f>qr.iih3, basrd nn educational 
qualifications of faculty, ideciujcy of r-talfing, quantity 
andqual3tyof taculty pnbl icat i Mn;;, departure's from 
Commissioner Regulation:,, unJ those clcumnts reviewed 
above undei"^ "Curriculum''. 

General impressions, including clarity of educational 
goals; adequacy of curricula; training, experience, and 
productivity of faculty; quality of students, academic 
counseling, library, other facilities; quality of graduates 
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